Lead Data Engineer

MITRE Corporation
McLean, VA, United States
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
$155,200.0 - $194,000.0
Working hours
Regular working hours

Tech stack

Airflow Amazon S3 Automation of Tests Big Data Cloud Computing Code Review Information Systems Computer Programming Databases Continuous Integration Information Engineering Data Governance
+34 more
Extract Transform Load (ETL) Data Security Data Systems Relational Databases Linux Distributed Computing Environment Apache Hadoop Python (Programming Language) Modular Design Performance Tuning Reliability Engineering Software Construction Software Engineering SQL Databases Data Streaming Unstructured Data Data Storage Technologies Cloud Platform System Apache Spark Git Microsoft Fabric Containerization Data Lakes Storage Technologies Information Technology Dask Apache Nifi Data Management Data Lakehouse Software Version Control Data Pipelines Amazon Elastic Mapreduce (EMR) Docker Databricks

Job description

  • Design, build, and operate secure, scalable, and maintainable data platforms and pipelines in cloud-based and self-hosted environments.
  • Develop batch and streaming data-processing solutions for structured, semi-structured, and unstructured data.
  • Create data models, schemas, interfaces, and storage architectures that support mission and analytical requirements.
  • Evaluate and improve data quality, lineage, governance, access controls, and secure data-handling practices.
  • Translate sponsor and stakeholder needs into technical requirements and practical engineering solutions.
  • Diagnose complex system, performance, reliability, and data-quality problems.
  • Evaluate emerging data technologies and recommend their use when they provide meaningful mission or engineering benefits.
  • Establish and promote software engineering practices such as automated testing, version control, code review, modular design, observability, and continuous integration.
  • Communicate complex technical concepts clearly to both technical and non-technical audiences.
  • Contribute to applied research, prototypes, and technical publications, as appropriate.
  • Lead technical workstreams or complex projects involving multiple contributors, dependencies, risks, and stakeholders.
  • Mentor engineers and transfer technical knowledge across teams.

The candidate should have hands-on experience in several of the areas specified below, however it is not required that a candidate has experience in all of these areas.

Data Engineering

  • Distributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, Dask
  • Data Storage and Data Lakehouse Architectures, such as RDBMS, Amazon S3, Iceberg, Delta Lake
  • Cloud-based Data Platforms, such as Databricks, Palantir Foundry, Microsoft Fabric, and Amazon EMR
  • Data Pipeline/ETL Development, Integration, and Orchestration, such as Airflow, Dagster, NiFi
  • Batch and Streaming Data Processing
  • Data Modeling, Schema Design, and Data Quality Assessment
  • Data Governance, Access Controls, and Secure Data Handling
  • Performance Optimization and Reliability Engineering

Software Development

  • Computer Programming and Databases - Advanced proficiency in Python and SQL required
  • Software Engineering Best Practices (e.g., version control, testing, modular design)
  • Linux-based Development Environments, Git, and Cloud Platforms
  • Use of Containerization and Orchestration, such as Docker and Kubernetes

Requirements

The successful candidate for this position is an experienced Data Engineer who combines strong foundations in computer science and software engineering with hands-on experience designing and implementing data systems to solve mission problems. This role requires practitioners with expertise in data modeling, processing, infrastructure engineering, and operational deployment. Our organization values innovation and believes that keeping up with the latest research and technologies is essential., * Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 8 years of relevant experience.

  • Advanced, hands-on proficiency with Data Engineering approaches, including distributed data processing, cloud-based data platforms, data lakehouse architectures, ETL orchestration, data modeling, and data governance.
  • Active DoD Top Secret Clearance.
  • Per the U.S. Government’s eligibility requirements for a clearance, U.S Citizenship is required.
  • This position requires a minimum of 50% hybrid on-site

Preferred Qualifications:

  • Master’s degree in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 6 years of relevant experience; PhD in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 3 years of relevant experience.
  • Active DoD Top Secret Clearance with Counterintelligence (CI) Polygraph.

Benefits & conditions

Why choose between doing meaningful work and having a fulfilling life? At MITRE, you can have both. That’s because MITRE people are committed to tackling our nation’s toughest challenges-and we’re committed to the long-term well-being of our employees. MITRE is different from most technology companies. We are a not-for-profit corporation chartered to work for the public interest, with no commercial conflicts to influence what we do. The R&D centers we operate for the government create lasting impact in fields as diverse as cybersecurity, healthcare, aviation, defense, and enterprise transformation. We’re making a difference every day-working for a safer, healthier, and more secure nation and world. Our workplace reflects our values. We offer competitive benefits, exceptional professional development opportunities for career growth, and a culture of innovation that embraces adaptability, collaboration, technical excellence, and people in partnership. If this sounds like the choice you want to make, then choose MITRE - and make a difference with us.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · WWC 2025

2:19 min

Scaling performance across multiple GPUs using specialized frameworks

Paul Graham Paul Graham · WWC 2025

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:39 min

Experiencing core Linux capabilities for DevOps administration

Michael Cade · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all