> Markdown version of [/jobs/ext/3075895-data-engineer-aws-spark](https://www.wearedevelopers.com/jobs/ext/3075895-data-engineer-aws-spark). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer (AWS, Spark) - **Company:** Flex Ltd. - **Location:** Washington, DC, United States - **Experience:** Expert - **Salary:** $103,000.0 - $140,000.0 - **Contract:** Permanent contract - **Skills:** Microsoft Excel, Artificial Intelligence, Amazon Web Services, Amazon S3, Apache HTTP Server, Information Engineering, Extract Transform Load (ETL), IBM InfoSphere DataStage, Programming Tools, Amazon DynamoDB, Python (Programming Language), Key Management, PostgreSQL, Machine Learning, Microsoft PowerPoint, SQL Databases, Parquet, Delivery Pipeline, Apache Spark, Cloudformation, Pyspark, Storage Technologies, Information Technology, Data Lineage, Amazon Simple Queue Service (SQS), Terraform, Data Pipelines, Amazon Elastic Mapreduce (EMR) - **Published:** September 25, 2026 - **Apply:** https://www.careerjet.com/job/register/us1191150905216454b5ec38ffaeeb2818 ## About the Role Clearance & Location: Sole United States citizenship and the ability to obtain a Public Trust determination are required. This is a full-time W-2 hybrid role based in the Washington, DC metropolitan area. Experience & Education: 4+ years of dedicated data engineering experience and a Bachelor's degree. Technical Stack: Hands-on Spark ETL on AWS (Glue, Amazon EMR) using Python and PySpark. S3 data-lake design (Parquet, partitioning, lifecycle) feeding Apache Iceberg tables, Amazon Aurora PostgreSQL, and DynamoDB. Event orchestration (Lambda, Step Functions, SQS/SNS) with secrets management and monitoring. Data quality, validation, data lineage, and Infrastructure-as-Code (CloudFormation or Terraform). Basic proficiency in writing, PowerPoint, and Excel. Bonus Points (Preferred) Master's degree in a relevant field. Experience with Trino or comparable federated SQL across lake and relational stores. Experience with Apache Ranger-governed access controls. Legacy ETL migration experience (e.g., DataStage). Federal IT experience or high-volume data experience, alongside familiarity with AI-assisted developer tooling., Machine Learning Engineer 5 (IC) Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative… ## Description Build the pipelines that move a federal agency's data from source to platform. In this role, you will work with a premier data and technology innovation hub and certified Benefit Corporation operating at the center of the US federal government's mission. They don't hire just to fill seats-they hire top-tier technical talent and move their best people to where the hardest problems are. As the work evolves, you will learn new systems and tools, take on greater responsibility, and help develop internal capabilities and new lines of business. Your First Project Your first project will have you building ingest, processing, and storage architecture at scale. Depending on the specific assignment, you will: Build Spark-based extract, transform, and load (ETL) pipelines using Glue, Amazon EMR, Lambda, and Step Functions. Write scalable data processing workflows in Python and PySpark. Design S3 data-lake layers (including Parquet, partitioning, and lifecycle policies) feeding Apache Iceberg tables. Connect PostgreSQL on Amazon Aurora and DynamoDB, using Trino for federated Structured Query Language (SQL) across relational stores and the lake. Deliver automated pipelines that keep data clean, trustworthy, and audit-ready at high-volume federal scale. (Note: This is just where you start, not the final shape of your career here.) Who You Are You are a data engineer driven to continuously improve, and you know which areas you want to master next. You care as much about whether data is trustworthy as whether it arrives on time, and you do your best work alongside teammates who push you. You experiment, learn, and iterate quickly, preferring to own an outcome rather than just be handed a task. What You Bring to the Table (Requirements), Machine Learning Engineer 4 (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the AI and technology space? Do you enjoy solving com… + 1 day ago ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)