Data Engineer

Dow
Falls Church, VA, United States
9 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours

Tech stack

Agile Methodology Amazon Web Services Application Integration Architecture Microsoft Azure Big Data Information Engineering Data Governance Data Systems Digital Assets Python (Programming Language) Operational Data Store SQL Databases
+7 more
Software Repository Data Ingestion Apache Spark Information Technology Data Management Data Pipelines Databricks

Job description

  • Design and build scalable data pipelines using Python, SQL, and Databricks (Spark) in support of financial management and operational analytics
  • Develop and maintain data products within Palantir Foundry, including pipelines, transforms, and user-facing workflows
  • Translate stakeholder and mission requirements into end-to-end technical solutions across Databricks and Foundry environments
  • Build and manage workflows and applications within Foundry to support operational and analytical use cases
  • Support development of financial analytics datasets used for DoD reporting and decision-making
  • Integrate and transform complex datasets from Advana and other DoD systems into production-ready data assets
  • Ensure data quality, reliability, and performance across pipelines and workflows
  • Collaborate directly with mission stakeholders to understand evolving requirements and deliver impactful solutions
  • Lead and mentor a team of data engineers, providing technical guidance and establishing best practices
  • Manage and prioritize work using Agile methodologies, ensuring consistent delivery and alignment with mission needs
  • Contribute to architecture decisions and help define scalable patterns for data ingestion, transformation, and consumption

Requirements

Citizenship & Clearance Requirement: per client requirements, candidates must be U.S. Citizens with an active DoW Secret clearance Education Requirement: Bachelor’s Degree in Computer Science, Engineering, or related field (preferred) 540 Internal Thrive Level: Senior Data Engineer, * 7+ years of data engineering or related experience

  • Strong hands-on experience with Databricks
  • Experience building and managing data pipelines in Python and Databricks
  • Experience working with Palantir Foundry, including building pipelines, workflows, or applications
  • Strong proficiency in SQL and Python
  • Experience designing and implementing end-to-end data solutions based on user or stakeholder requirements
  • Experience working within DoW environments or supporting government programs
  • Experience working with Advana or similar large-scale government data platforms
  • Experience supporting financial management or financial analytics use cases
  • Experience leading or mentoring data engineering teams
  • Experience working in Agile environments and managing work across sprints
  • Strong communication skills and ability to work directly with technical and non-technical stakeholders, * Experience working with Warfighter or operational data platforms
  • Familiarity with Palantir Foundry application development patterns (Ontology, Code Repositories, Workshop, etc.)
  • Experience optimizing Spark jobs and Databricks performance
  • Experience with data governance, lineage, and access controls in enterprise environments
  • Experience integrating APIs and external data sources
  • Experience working with very large datasets (billions of records)
  • Experience with cloud platforms (AWS, Azure, or GCP)

Benefits & conditions

  • Flexible PTO + all Federal holidays off
  • Health, dental and vision insurance plans
  • Flexible Spending Account (FSA)
  • 401k with employer match
  • Company-sponsored life insurance, short- and long-term disability
  • Professional development (training, certifications, conferences)
  • Paid cloud developer accounts
  • Referral bonuses
  • HQ office perks (parking / metro reimbursement, nitro coffee & lunches)
  • Annual social events (540 Week, hackathon, charity golf tournament, etc.)
  • Access to 540’s Washington Capitals & Nationals tickets

About the company

540 is seeking a Senior Data Engineer to support mission-critical financial analytics initiatives within the DoW, including work on the War Data Platform ((WDP) formerly Advana) and broader warfighter data environments.

In this role, you’ll design and deliver end-to-end data solutions that power financial management and operational decision-making across complex DoW systems. You’ll work across Databricks and Palantir Foundry environments to build scalable data pipelines, develop production-grade data products, enable advanced analytics, and AI workflows for mission stakeholders.

This is a hands-on technical leadership role ideal for someone who thrives in complex data environments, enjoys working directly with users, and can translate real-world requirements into scalable data solutions.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:04 min

Comparing offline data analytics with online stream processing

Artem Volk Artem Volk +1 · World Congress 2024

Videos

See all

Related articles

See all