Senior Data Engineer (DV Cleared)

We're seeking a detail-oriented, analytical Senior Data Engineer to join a high-performing multi-disciplinary data team. You'll be essential to building and maintaining robust data pipelines and bespoke applications, ensuring data-driven projects deliver against demanding customer timelines and requirements. Core Responsibilities

Pipeline Engineering:

• Design, manage, and optimise data ingestion pipelines and orchestration workflows
• Develop and maintain end-to-end bespoke data projects from requirements to production
• Monitor system performance and ensure high uptime across Linux-based infrastructure
• Collaborate closely with data scientists, analysts, product owners, and engineering teams

Technical Delivery:

• Implement scalable data processing solutions handling complex, high-volume datasets
• Drive continuous improvement in pipeline reliability, performance, and observability
• Support cross-functional delivery of mission-critical intelligence platforms

Core Technical Expertise:

• Strong Python proficiency for data engineering and pipeline development
• Linux systems administration and performance optimisation experience
• Hands-on with Python orchestration frameworks (Dagster, Apache Airflow)

Cloud & Infrastructure:

• Serverless AWS experience (Lambda, Step Functions, Athena, Glue)
• Docker containerisation - building/maintaining production-grade containers
• Kubernetes familiarity for container orchestration and scaling

Security & Compliance:

• Knowledge of security, encryption, and compliance standards for secure networks
• Experience delivering data platforms in high-security environments