SC Cleared Data Engineer

We are seeking an experienced SC Cleared Data Engineer to design, build, and maintain secure, scalable data platforms and pipelines within a high-security environment. The successful candidate will work closely with data architects, analysts, software engineers, and stakeholders to deliver robust data solutions that support operational and strategic objectives., * Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data sources.

• Build scalable data ingestion and transformation frameworks using cloud-native and on-premise technologies.
• Develop and optimise data models, warehouses, and lakehouse architectures.
• Implement data quality, validation, governance, and security controls.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Monitor, troubleshoot, and optimise data workflows and platform performance.
• Support CI/CD practices and infrastructure automation for data platforms.
• Produce technical documentation, architecture diagrams, and operational runbooks.
• Ensure compliance with security policies, governance standards, and best practices within secure environments.
• Participate in agile ceremonies including sprint planning, stand-ups, and retrospectives.

• Active SC Clearance or eligibility to obtain SC clearance.
• Proven experience as a Data Engineer in enterprise or government environments.
• Proficiency in SQL and Python for data engineering tasks.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Hands-on experience with data technologies including Apache Spark, Databricks, Kafka, Airflow, Snowflake, and Hadoop ecosystems.
• Experience designing and maintaining data warehouses and data lakes.
• Knowledge of DevOps and CI/CD tooling including Git, Jenkins, Azure DevOps, and Terraform.
• Strong understanding of data governance, security, and compliance.
• Experience working within Agile delivery teams.

Desirable Skills

• Experience in the public sector, defence, or regulated industries.
• Knowledge of data mesh or modern data architecture principles.
• Experience with containerisation technologies such as Docker and Kubernetes.
• Familiarity with machine learning pipelines and MLOps.
• Certifications in cloud platforms or data engineering technologies.