Data Engineer - SC Cleared - £550p/d Outside IR35 - Remote

We’re urgently looking for an experienced Data Engineer with strong AWS, Python and Apache Airflow skills to join a programme on an initial six-month contract.

You’ll help build and maintain reliable data pipelines, develop cloud-based data solutions and make data available for downstream analytics and programme requirements. This opportunity would suit someone who combines practical engineering skills with a focus on data quality, reliability and maintainability.

Experience supporting machine learning or artificial intelligence programmes would be valuable. Marine or geospatial data experience would also be a significant advantage, although neither is essential.

What you’ll be doing

• Developing and maintaining data pipelines using Python and AWS services.
• Building, scheduling and monitoring data workflows with Apache Airflow.
• Integrating data from multiple sources and preparing it for downstream use.
• Improving pipeline reliability, performance and data quality.
• Investigating data processing issues and implementing robust solutions.
• Working with technical colleagues and stakeholders to understand data requirements.
• Writing clear, maintainable code and documenting data workflows and processes.
• Applying appropriate security practices when handling data and developing solutions.

• Strong commercial experience in data engineering.
• Hands-on experience building and supporting data solutions on AWS.
• Strong Python development skills for data processing and integration.
• Practical experience using Apache Airflow to orchestrate data workflows.
• Experience developing reliable, maintainable data pipelines.
• A methodical approach to troubleshooting and resolving data issues.
• The ability to communicate clearly and work effectively in a remote team.

Desirable experience The following would strengthen your application but are not essential:

• Experience delivering data engineering within ML or AI programmes.
• Experience working with marine data.
• Experience processing or managing geospatial datasets.