Data Engineer

Seeking a talented Data Engineer to play a vital role in shaping and maintaining the data foundation essential for Our Client’s AI-native readiness solutions. This position offers a unique opportunity to work on high-stakes, high-volume datasets from defence and government clients, transforming raw data into reliable, analysis-ready inputs that directly influence decision-making processes. As a key member of the team, you will collaborate closely with data scientists, machine learning engineers, and platform specialists to develop robust data pipelines and infrastructure that meet stringent security and compliance standards. This role is instrumental to advancing the company’s mission of delivering operational certainty and actionable insights., * Design, develop, and sustain scalable, secure data pipelines for data ingestion, transformation, and delivery, accommodating both cloud and hybrid environments.

• Manage structured and unstructured data to support AI/ML workflows, analytics, and application development.
• Collaborate with cross-functional teams to productionise data workflows, feature pipelines, and model inputs.
• Enhance automation processes for data quality, validation, lineage tracing, and monitoring.
• Optimize data storage solutions, query performance, and cost-efficiency across relational and object data repositories.
• Implement data security protocols, access controls, and governance consistent with government and defence standards.
• Support data integration efforts within secure DoD environments and customer-specific settings.
• Troubleshoot and resolve data-related issues to ensure pipeline reliability and performance.
• Work with platform and AI engineers to maintain secure, scalable, and efficient data architecture., Joining Our Client means becoming part of a dedicated team tackling significant national and infrastructure challenges. From day one, you will have opportunities to take ownership of meaningful projects and accelerate your professional growth in a rapidly expanding organisation. Benefits include comprehensive health coverage, flexible working arrangements, unlimited paid time off, and a collaborative environment committed to excellence and innovation. Whether working in the office or remotely, you will be empowered to make a real difference with your expertise.

• Active US Government Security Clearance (SECRET or higher) is mandatory.
• Bachelor’s degree in Computer Science, Engineering, or a related discipline.
• Minimum of 4 years’ experience in data engineering and building production data pipelines.
• Proficiency in Python and SQL.
• Hands-on experience with distributed processing frameworks such as Spark.
• Strong knowledge of relational databases (PostgreSQL, MySQL) and data modelling.
• Advanced experience with AWS cloud services (S3, RDS, EMR, Lambda, IAM, CloudWatch) in secure environments.
• Proven track record of implementing data quality, validation, and observability solutions.
• Familiarity with containerisation (Docker, Kubernetes) and Infrastructure as Code tools like Terraform.

Nice-to-Have Skills

• Experience deploying within DoD environments or using platforms like Platform One or Palantir FedStart.
• Knowledge of security standards such as NIST 800-53, NIST 800-171, and CMMC 2.0.
• Supporting data infrastructure for Machine Learning/Data Science teams.
• Experience with data orchestration tools such as Airflow, dbt, or Dagster.
• Familiarity with streaming data or real-time processing technologies like Kafka.
• Knowledge of data warehousing or lakehouse architectures.
• Experience working within fast-growing teams and mentoring junior engineers.

Our Client is a pioneering organisation at the forefront of AI-driven solutions for defence, government, and critical infrastructure sectors. With a heritage rooted in advanced research and innovation, the company is renowned for its commitment to solving some of the world’s most complex, mission-critical challenges through cutting-edge AI technology. Known for a culture that values transparency, results, and compassion, Our Client fosters an environment where talented professionals can thrive and make a tangible impact. By continually pushing the boundaries of innovation, they have developed a portfolio of patents and are leading the transition towards agent-driven readiness in AI applications.