Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+37 more
Job description
We are seeking a Data Engineer / Systems Engineer to support mission-critical data operations for a cutting-edge defense and intelligence platform. In this role, you will design, configure, and maintain high-volume data ingest and distribution pipelines that power real-time decision-making across complex environments. The ideal candidate has strong hands-on experience with PostgreSQL, SQL, and Python, along with a solid foundation in Linux-based systems, ETL workflows, cloud technologies, and data integration. You will work closely with software engineers, system administrators, data providers, and end users to ensure the reliable flow of mission-relevant data through a highly available, secure, and scalable ecosystem.
This is an opportunity to join a fast-paced engineering team that leverages modern technologies including AWS, Kubernetes, GitLab, Kafka, REST APIs, and cloud-native data pipelines to solve complex technical challenges supporting national security missions. Success in this role requires strong troubleshooting skills, a continuous delivery mindset, and the ability to manage multiple priorities while maintaining data integrity, resiliency, and operational excellence.
The Opportunity:
- Our engineering teams are highly adept at solving complex problems with the application of leading-edge technology, empowering the intelligence and defense communities as they make mission-critical decisions.
- Work in a fast-paced environment with many moving parts while managing several tasks at once. All while bringing a continuous delivery mindset to achieve high availability goals for the flow of data to and through the system.
- Work with external data providers, users, and stakeholders to engineer the ingest and distribution of mission-relevant data feeds into the FADE data ecosystem.
- Utilize modern technologies to create and maintain hundreds of integrated data pipelines across multiple networks, while ensuring data resiliency and reliability.
- Focus on the operations of COTS and GOTS software to ensure low latency and high integrity of quality data through hundreds of pipelines.
- Responsibilities:
- Configure and maintain data ingest workflows (ETL) across multiple production systems
- Install, configure, and update a wide array of COTS/GOTS software applications
- Support and troubleshoot diverse IT infrastructure hardware platforms and protocols
- Work with software development and systems administration staff to monitor and troubleshoot production systems
- Generate and maintain systems documentation and diagrams
- Troubleshoot network issues and establish new connectivity
- Monitor and maintain a variety of databases
Requirements
Required:
- Education: Bachelor’s degree or equivalent (master’s preferred)
- Minimum 3 years of experience with software development programs
- Must be certified to meet DoD 8570 level IAT-II qualifications. Security+ certification or CISSP preferred. This certification must be obtained within 6 months of hire if not already certified and maintained throughout your time in the position.
- Ability to work in a dual-hatted, agile environment while juggling multiple tasks with shifting priorities
- Strong systems engineering background including scripting skills in Python and Bash
- Developing in a Linux environment, Commercial Cloud Systems, (AWS - EC2, RDS, S3)
- Engineering management tools (JIRA/Confluence), RDBMS databases (PostgreSQL, Oracle, MySQL)
- Git version-control system, CI/CD tools such as Docker, Kubernetes, Helm, GITLAB Runners,
- Common data/configuration formats: Delimited, JSON, GeoJSON, YAML, Common API/interfaces: REST, SFTP, Kafka, AMQ, Socket
Preferred/Desired:
- Experience with: AWS: Diode, Flink, ArgoCD
- Monitoring tools (Grafana and Kibana)
- Understanding of compiled languages including Java
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again
Top-Paying Tech Jobs (with Salaries)
The Most Popular IT Jobs on the Market