Data Engineer
Role details
Job location
Tech stack
Job description
SITA is seeking a skilled professional to join their data team in Madrid, specializing in Big Data systems. You will work on cloud-based architectures and data pipelines, collaborating with various stakeholders to drive AI/ML initiatives., * Work on designing scalable cloud-based data architectures.
- Develop reference ingestion patterns for data integration.
- Maintain data pipelines and advise best ETL/ELT practices.
Conocimientos
Big Data systems SQL Python Databricks Spark Cloud deployment
Herramientas
Databricks Power BI Tableau Azure Event Hub Kafka Descripción del empleo About The Role And The Team
You will be part of the highly talented individuals' team responsible for bringing the Air Transport Industry data to the next level. Your day-by-day work will include working with data pipelines, extracting and digging into different datasets coming from airports, airplanes, and ground handlers to understand them and gain insights that we then use to train ML models, making this industry more reliable and easier to operate. SITA is the biggest tech service provider worldwide for the Air Transport Industry. We have tons of data and now want to make use of it to make our customers' lives easier. What You Will Do
- Work together with the team in designing scalable cloud-based data architectures with a focus on performance, cost-efficiency, and security.
- Develop reference ingestion patterns and templates for integrating data from enterprise systems, APIs, and external datasets.
- Develop and maintain pipelines (e.g., platform services, system tables, reference implementations) and provide guidance on ETL/ELT best practices for portfolio teams.
- Apply data governance, cataloguing, and quality monitoring (compliance with guidelines) to ensure trustworthy and well-documented data.
- Collaborate with data architects, scientists, analysts, and business stakeholders across the Air Transport Industry to translate requirements into technical solutions.
- Apply modern technologies (e.g., Databricks, AzureML, LLMs) to enable advanced analytics and AI/ML use cases (use-case driven)., We offer flexible working arrangements: Flex Week (up to 2 days work-from-home per week), Flex Day (flexible workday), and Flex-Location (up to 30 days per year to work from any location). We also provide Employee Well-being programs, professional development opportunities, and competitive benefits aligned with local markets.
Requirements
The ideal candidate has 3-5 years of experience in Big Data, proficiency in SQL and Python, and is familiar with tools like Databricks and Spark. The company offers flexible working arrangements and a commitment to workforce diversity., * 3-5 years of technical experience with Big Data systems.
- Familiarity with Databricks, Spark and event streaming.
- Proficiency in SQL and Python, with clean coding practices., * 3-5 years of technical experience with Big Data systems.
- Familiarity with Databricks, Spark and event streaming (e.g., Azure Event Hub, Kafka).
- Proficiency in SQL and Python, with clean coding and OOP practices.
- Cloud deployment experience (Azure preferred).
- Strong collaboration skills, with the ability to enable and advise teams without taking ownership of their delivery.
- Proactive and solution-oriented mindset.
- Flexibility and adaptability in dynamic environments.
- Curiosity and eagerness to learn new tools and improve processes.
NICE-TO-HAVE
- Knowledge of data visualization (e.g., Power BI, Databricks Dashboards, Tableau, etc).
- Strong understanding of dimensional modelling and data warehouse design.