Data Engineer (Python)
Role details
Job location
Tech stack
Job description
A Senior Data Engineer has a strong expertise in Python and modern data engineering tools to help build and evolve our enterprise data ecosystem. Work Location Hybrid. Madrid city center (Sol area). 3 days a week in the office + 2 days remote. Main tasks and accountabilities will be: Design, build, and optimize scalable Python-based ETL/ELT pipelines using tools such as pandas, Polars, or similar frameworks Build and orchestrate data pipelines using Dagster, Airflow or similar tools Develop efficient data ingestion pipelines for batch, incremental and streaming scenarios Integrate with internal and external APIs, ensuring robust authentication, error handling and data quality Work with Docker, Kubernetes, and GitLab to deploy, operate, and monitor data pipelines in production Develop and maintain CI/CD pipelines for data workflows, library packaging, and infrastructure components
Requirements
Expert-levelPython skills(pandas/Polars, typing, packaging, testing, performance optimization) Solid experience with data orchestration frameworks (Dagster preferred; Airflow or similar tool is a strong plus) Strong understanding ofdata modelling, ETL patterns, and performance considerations Proficiency with Docker, Kubernetes, and GitLab CI/CD Hands-on experience with SQL and relational databases (MS SQL preferred, PostgreSQL/Oracle is a plus) Practical experience with Azure data and compute services (Databricks, ADLS, ADF)and foundational knowledge of Azure networking, AAD, and security concepts; comparable experience with AWS or GCP is equally valued 5+ years of experience in data engineering or backend engineering with a strong data focus English: fluent (written and spoken); Spanish: nice-to-have
Benefits & conditions
?? 23 days of Annual Leave plus the 24th and 31st of December as discretionary days! ?? Numerous benefits (Health Care Plan, teleworking compensation, Life and Accident Insurances). `Retribución Flexible ´ Program: (Meals, Kinder Garden, Transport, online English lessons, Health Care Plan...) Free access to several training platforms Professional stability and career plans UST also, compensates referrals from which you could benefit when you refer professionals. The option to pick between 12 or 14 payments along the year. Real Work Life Balance measures (flexibility, WFH or remote work policy, compacted hours during summertime...) UST Club Platform discounts and gym Access discounts If you would like to know more, don't hesitate to apply and we'll get in touch to fill you in detail. We are waiting for you! In UST we are committed to equal opportunities in our selection processes and do not discriminate based on race, gender, disability, age, religion, sexual orientation or nationality. We have a special commitment to Disability & Inclusion, so we are interested in hiring people with disability certificate.