Data Engineer - Airflow/AWS/Python

You will work closely with senior data engineers and the wider technology team, providing operational support and helping to ensure our data pipelines are reliable, scalable and fit for purpose., * Design, develop and maintain robust and scalable data pipelines.

• Develop and maintain data workflows using Apache Airflow.
• Build and enhance data engineering solutions using Python.
• Work with AWS cloud services to support data processing, storage and pipeline infrastructure.
• Monitor day-to-day pipeline performance and investigate failures or data issues.
• Provide operational support to the senior data engineering team.
• Troubleshoot production data pipeline issues and implement appropriate fixes.
• Contribute to data quality initiatives, including identifying, monitoring and resolving data quality issues.
• Implement data validation and quality checks across pipelines and datasets.
• Support continuous improvements to pipeline reliability, performance and maintainability.
• Collaborate with senior engineers, analysts and other stakeholders to understand data requirements.
• Follow engineering best practices around testing, documentation, version control and deployment.
• Participate in incident resolution and root-cause analysis where required.

We are looking for an experienced Data Engineer with a minimum of 3 years’ commercial experience to join our data engineering team. The successful candidate will have strong hands-on experience with AWS, Apache Airflow and Python, together with a good understanding of data quality and production data pipelines., * Minimum 3 years’ experience in Data Engineering or a closely related role.

• Strong hands-on Python development experience.
• Practical experience with AWS cloud technologies and services.
• Strong experience using Apache Airflow to develop and manage data workflows.
• Experience working with production data pipelines and supporting operational environments.
• Demonstrable experience delivering or contributing to data quality projects.
• Strong troubleshooting and problem-solving skills.
• Understanding of data engineering principles, ETL/ELT processes and data pipeline architecture.
• Experience working with relational databases and SQL.
• Familiarity with Git and standard software development practices.
• Ability to work effectively with senior technical colleagues and provide reliable day-to-day operational support.

Desirable Experience

• Experience with AWS services such as S3, Lambda, Glue, Redshift or CloudWatch.
• Experience with data quality or data observability tools.
• Experience with CI/CD and automated testing.
• Knowledge of infrastructure-as-code technologies such as Terraform.
• Experience working within Agile/Scrum development environments.
• Experience with large-scale or cloud-based data platforms.

Personal Attributes

• Strong analytical and problem-solving ability.
• Proactive approach to identifying and resolving issues.
• Comfortable working in a production environment where reliability is important.
• Strong attention to detail, particularly around data accuracy and quality.
• Good communication skills and the ability to work collaboratively with senior team members.
• Willingness to learn new technologies and continuously improve existing processes.
• Able to manage competing priorities while maintaining a high standard of delivery.

Madrid, Spain - EUR30.00 - EUR34 per hour Contract Posted by Square One Resources

Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.