> Markdown version of [/jobs/ext/2981784-data-engineer](https://www.wearedevelopers.com/jobs/ext/2981784-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** IO Associates - **Location:** United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Query Performance, Artificial Intelligence, Airflow, Amazon S3, Data Analysis, Data Architecture, Information Engineering, Data Infrastructure, Data Integration, Data Security, Data Stores, Data Warehousing, Relational Databases, Distributed Computing Environment, Identity and Access Management, Python (Programming Language), PostgreSQL, Machine Learning, MySQL, Operational Databases, Cloud Services, Software Engineering, SQL Databases, Data Streaming, Unstructured Data, Data Storage Technologies, Real Time Systems, Data Ingestion, Apache Spark, Containerization, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Apache Kafka, Machine Learning Operations, Functional Programming, Cloudwatch, Terraform, Data Pipelines, Docker - **Published:** September 18, 2026 - **Apply:** https://www.dice.com/job-detail/9b0fbac7-0eee-41af-a669-4a38abd36f4e ## About the Role * Active US Government Security Clearance (SECRET or higher) is mandatory. * Bachelor's degree in Computer Science, Engineering, or a related discipline. * Minimum of 4 years' experience in data engineering and building production data pipelines. * Proficiency in Python and SQL. * Hands-on experience with distributed processing frameworks such as Spark. * Strong knowledge of relational databases (PostgreSQL, MySQL) and data modelling. * Advanced experience with AWS cloud services (S3, RDS, EMR, Lambda, IAM, CloudWatch) in secure environments. * Proven track record of implementing data quality, validation, and observability solutions. * Familiarity with containerisation (Docker, Kubernetes) and Infrastructure as Code tools like Terraform. Nice-to-Have Skills * Experience deploying within DoD environments or using platforms like Platform One or Palantir FedStart. * Knowledge of security standards such as NIST 800-53, NIST 800-171, and CMMC 2.0. * Supporting data infrastructure for Machine Learning/Data Science teams. * Experience with data orchestration tools such as Airflow, dbt, or Dagster. * Familiarity with streaming data or real-time processing technologies like Kafka. * Knowledge of data warehousing or lakehouse architectures. * Experience working within fast-growing teams and mentoring junior engineers. ## Description Seeking a talented Data Engineer to play a vital role in shaping and maintaining the data foundation essential for Our Client's AI-native readiness solutions. This position offers a unique opportunity to work on high-stakes, high-volume datasets from defence and government clients, transforming raw data into reliable, analysis-ready inputs that directly influence decision-making processes. As a key member of the team, you will collaborate closely with data scientists, machine learning engineers, and platform specialists to develop robust data pipelines and infrastructure that meet stringent security and compliance standards. This role is instrumental to advancing the company's mission of delivering operational certainty and actionable insights., * Design, develop, and sustain scalable, secure data pipelines for data ingestion, transformation, and delivery, accommodating both cloud and hybrid environments. * Manage structured and unstructured data to support AI/ML workflows, analytics, and application development. * Collaborate with cross-functional teams to productionise data workflows, feature pipelines, and model inputs. * Enhance automation processes for data quality, validation, lineage tracing, and monitoring. * Optimize data storage solutions, query performance, and cost-efficiency across relational and object data repositories. * Implement data security protocols, access controls, and governance consistent with government and defence standards. * Support data integration efforts within secure DoD environments and customer-specific settings. * Troubleshoot and resolve data-related issues to ensure pipeline reliability and performance. * Work with platform and AI engineers to maintain secure, scalable, and efficient data architecture., Joining Our Client means becoming part of a dedicated team tackling significant national and infrastructure challenges. From day one, you will have opportunities to take ownership of meaningful projects and accelerate your professional growth in a rapidly expanding organisation. Benefits include comprehensive health coverage, flexible working arrangements, unlimited paid time off, and a collaborative environment committed to excellence and innovation. Whether working in the office or remotely, you will be empowered to make a real difference with your expertise. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)