Big Data Engineer

Community Of
Municipality of Madrid, Spain
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Municipality of Madrid, Spain

Tech stack

Agile Methodologies
Artificial Intelligence
Application Lifecycle Management
Big Data
Code Review
Computer Engineering
ETL
Data Systems
Elasticsearch
IntelliJ
Python
PostgreSQL
Machine Learning
Microsoft Visual Studio
MongoDB
NoSQL
SQL Databases
Spark
GIT
PySpark
Information Technology
Databricks

Requirements

In the GTM analytics COE our mission is to deliver impact by building machine learning products to optimize pricing and marketing investments and provide guidance to our sales organization. As a Big Data Engineer, you will be in a unique position to support the development one of our internal assets. You will work together with the project and asset team to understand the end state in which the data must be delivered and you will model the data using Big Data technologies like Spark. What distinguishes us: We offer an international experience, collaborative culture, top rate experience in AI and ML and opportunity to create significant real-world impact. What you will be doing: Create / Maintain ETL pipelines; Review and evaluate designs and project activities for compliance with architecture, security and quality guidelines and standards; Provides tangible feedback to improve product quality and mitigate failure risk; Design data systems/solutions to manage complex data in complex, distributed and massively parallel systems; Ability to effectively communicate product architectures, design proposals and negotiate options at senior management level; Provide guidance to lower-level team members. What you will need: Bachelor's in Computer Engineering, Computer Science, Electrical Engineering, Robotics or a related field; 6+ years in a similar role; Strong problem-solving skills; Agile experience; Experience with modern application lifecycle management tools (Git, Visual Studio, Intellij, Code Reviews); Proficient in at least one of the following languages: Python, PySpark, Spark, SparkR. Nice to have: Experience with Databricks; Experience with SQL & NoSQL databases (PostgreSQL, MongoDB, Elastic Search).

Apply for this position