> Markdown version of [/jobs/ext/2059804-data-engineer](https://www.wearedevelopers.com/jobs/ext/2059804-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Marathon TS Inc - **Location:** Washington, DC, United States - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Airflow, Amazon Web Services, Amazon S3, Data Analysis, Computing Platforms, Big Data, Collaborative Software, Information Systems, Databases, Data Architecture, Data Dictionary, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Stores, Data Systems, DevOps, Distributed Computing Environment, Amazon DynamoDB, Elasticsearch, Push Technology, Java Message Service (JMS), Python (Programming Language), PostgreSQL, MongoDB, Object-Oriented Software Development, Open Source Technology, Raw Data, Redis, Software Tools, Amazon Simple Notification Service (SNS), SQL Databases, Data Streaming, Systems Architecture, Scripting, Cloud Platform System, AWS Lambda, Pandas, Kubernetes, Atlassian Tools, Apache Kafka, Apache Nifi, Data Management, 3-tier Architectures, Data Delivery, Amazon Simple Queue Service (SQS), Data Pipelines, Docker, Server Operating Systems & Platforms, Amazon Redshift - **Published:** August 14, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9091397/data-engineer ## About the Role * Bachelor's degree or equivalent practical experience. * Expertise in distributed computing frameworks to handle large-scale data processing. * Familiarity working with Amazon Web Managed Services (AWS) or any other cloud environments. * Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch and SQL. * Proficient utilizing Python with key libraries like pandas and PySark, NiFi, Airflow, AWS Lambda or similar technologies. * Working knowledge with software platforms and services, such as Docker, Kubernetes, JMS/SQS, SNS and Kafka. * Familiar with Linux/Unix server environments. * Experience with Agile development methodology. * Publishing and/or presenting design reports. * Coordinating with other team members to reach project milestones and deadlines. * Working knowledge with Collaboration tools, such as, Jira and Confluence., * Master's degree or equivalent experience in a related field. * Familiarity and experience with the Intelligence Community (IC), and the Client cycle. * Familiarity and experience with the Department of Homeland Security (Client). * Direct Experience with Client and Intelligence Community (IC) component's data architectures and environments (IC-GovCloud experience preferred). * Experience with cloud message APIs and usage of push notifications. * Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security. * Working knowledge with public keys and digital certificates. * Experience with DevOps environments. * Expertise in various COTS, GOTS, and open source tools which support development of data integration and visualization applications. * Experience with cloud message APIs and usage of push notifications. * Specialization in Object Oriented Programming languages, scripting, and databases. Role Requirements : * Active TS/SCI * Full Time * High colocation, 70-80% onsite ## Description As a Data Engineer, you will be required to interpret business needs and select appropriate technologies and have experience in implementing data governance of shared and/or master sets of data. You will work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions. You will create, maintain, and optimize data pipelines as workloads move from development to production for specific use cases to ensure seamless data flow for the use case. You will perform technical and non-technical analyses on project issues and help to ensure technical implementations follow quality assurance metrics. You will analyze data and systems architecture, create designs, and implement information systems solutions., * Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. * Develop and design data pipelines to support an end-to-end solution. * Develop and maintain artifacts (e.g., schemas, data dictionaries, and transforms related to ETL processes). * Integrate data pipelines with AWS cloud services to extract meaningful insights. * Work with stakeholders to support their data infrastructure needs and assist with data-related technical issues. * Design and develop robust and functional dataflows to support raw data and expected data. * Provide Tier 3 technical support for deployed applications and dataflows. * Define and communicate a clear product vision for our client's software products, aligning user needs and business objectives. * Create and manage product roadmaps that reflect both innovation and growth strategies. * Partner with a government product owner and a product team of 7-8 FTEs. * Collaborate with the rest of data engineering team to design and launch new features. * Coordinate and document dataflows, capabilities, etc. * Occasionally (as needed) support to off-hours deployment such as evening or weekends. ## Related Videos - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Database DevOps with Containers](https://www.wearedevelopers.com/videos/145-database-devops-with-containers) - [Accelerating Authentication Architecture: Taking Passwordless to the Next Level](https://www.wearedevelopers.com/videos/733-accelerating-authentication-architecture-taking-passwordless-to-the-next-level) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)