Data Engineer

Sita
Municipality of Madrid, Spain
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Shift work
Languages
English
Experience level
Intermediate
Compensation
€ 65K

Job location

Municipality of Madrid, Spain

Tech stack

Clean Code Principles
API
Artificial Intelligence
Azure
Business Intelligence
Big Data
Cloud Computing
Data Governance
Data Integration
ETL
Data Visualization
Data Warehousing
Dimensional Modeling
Python
Machine Learning
Object-Oriented Software Development
Power BI
SQL Databases
Data Streaming
Tableau
Cloud Platform System
Large Language Models
Spark
Kafka
Data Pipelines
Workday
Databricks

Job description

SITA is seeking a skilled professional to join their data team in Madrid, specializing in Big Data systems. You will work on cloud-based architectures and data pipelines, collaborating with various stakeholders to drive AI/ML initiatives., * Work on designing scalable cloud-based data architectures.

  • Develop reference ingestion patterns for data integration.
  • Maintain data pipelines and advise best ETL/ELT practices.

Conocimientos

Big Data systems SQL Python Databricks Spark Cloud deployment

Herramientas

Databricks Power BI Tableau Azure Event Hub Kafka Descripción del empleo About The Role And The Team

You will be part of the highly talented individuals' team responsible for bringing the Air Transport Industry data to the next level. Your day-by-day work will include working with data pipelines, extracting and digging into different datasets coming from airports, airplanes, and ground handlers to understand them and gain insights that we then use to train ML models, making this industry more reliable and easier to operate. SITA is the biggest tech service provider worldwide for the Air Transport Industry. We have tons of data and now want to make use of it to make our customers' lives easier. What You Will Do

  • Work together with the team in designing scalable cloud-based data architectures with a focus on performance, cost-efficiency, and security.
  • Develop reference ingestion patterns and templates for integrating data from enterprise systems, APIs, and external datasets.
  • Develop and maintain pipelines (e.g., platform services, system tables, reference implementations) and provide guidance on ETL/ELT best practices for portfolio teams.
  • Apply data governance, cataloguing, and quality monitoring (compliance with guidelines) to ensure trustworthy and well-documented data.
  • Collaborate with data architects, scientists, analysts, and business stakeholders across the Air Transport Industry to translate requirements into technical solutions.
  • Apply modern technologies (e.g., Databricks, AzureML, LLMs) to enable advanced analytics and AI/ML use cases (use-case driven)., We offer flexible working arrangements: Flex Week (up to 2 days work-from-home per week), Flex Day (flexible workday), and Flex-Location (up to 30 days per year to work from any location). We also provide Employee Well-being programs, professional development opportunities, and competitive benefits aligned with local markets.

Requirements

The ideal candidate has 3-5 years of experience in Big Data, proficiency in SQL and Python, and is familiar with tools like Databricks and Spark. The company offers flexible working arrangements and a commitment to workforce diversity., * 3-5 years of technical experience with Big Data systems.

  • Familiarity with Databricks, Spark and event streaming.
  • Proficiency in SQL and Python, with clean coding practices., * 3-5 years of technical experience with Big Data systems.
  • Familiarity with Databricks, Spark and event streaming (e.g., Azure Event Hub, Kafka).
  • Proficiency in SQL and Python, with clean coding and OOP practices.
  • Cloud deployment experience (Azure preferred).
  • Strong collaboration skills, with the ability to enable and advise teams without taking ownership of their delivery.
  • Proactive and solution-oriented mindset.
  • Flexibility and adaptability in dynamic environments.
  • Curiosity and eagerness to learn new tools and improve processes.

NICE-TO-HAVE

  • Knowledge of data visualization (e.g., Power BI, Databricks Dashboards, Tableau, etc).
  • Strong understanding of dimensional modelling and data warehouse design.

Apply for this position