Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+7 more
Job description
- Design and build scalable data pipelines using Python, SQL, and Databricks (Spark) in support of financial management and operational analytics
- Develop and maintain data products within Palantir Foundry, including pipelines, transforms, and user-facing workflows
- Translate stakeholder and mission requirements into end-to-end technical solutions across Databricks and Foundry environments
- Build and manage workflows and applications within Foundry to support operational and analytical use cases
- Support development of financial analytics datasets used for DoD reporting and decision-making
- Integrate and transform complex datasets from Advana and other DoD systems into production-ready data assets
- Ensure data quality, reliability, and performance across pipelines and workflows
- Collaborate directly with mission stakeholders to understand evolving requirements and deliver impactful solutions
- Lead and mentor a team of data engineers, providing technical guidance and establishing best practices
- Manage and prioritize work using Agile methodologies, ensuring consistent delivery and alignment with mission needs
- Contribute to architecture decisions and help define scalable patterns for data ingestion, transformation, and consumption
Requirements
Citizenship & Clearance Requirement: per client requirements, candidates must be U.S. Citizens with an active DoW Secret clearance Education Requirement: Bachelor’s Degree in Computer Science, Engineering, or related field (preferred) 540 Internal Thrive Level: Senior Data Engineer, * 7+ years of data engineering or related experience
- Strong hands-on experience with Databricks
- Experience building and managing data pipelines in Python and Databricks
- Experience working with Palantir Foundry, including building pipelines, workflows, or applications
- Strong proficiency in SQL and Python
- Experience designing and implementing end-to-end data solutions based on user or stakeholder requirements
- Experience working within DoW environments or supporting government programs
- Experience working with Advana or similar large-scale government data platforms
- Experience supporting financial management or financial analytics use cases
- Experience leading or mentoring data engineering teams
- Experience working in Agile environments and managing work across sprints
- Strong communication skills and ability to work directly with technical and non-technical stakeholders, * Experience working with Warfighter or operational data platforms
- Familiarity with Palantir Foundry application development patterns (Ontology, Code Repositories, Workshop, etc.)
- Experience optimizing Spark jobs and Databricks performance
- Experience with data governance, lineage, and access controls in enterprise environments
- Experience integrating APIs and external data sources
- Experience working with very large datasets (billions of records)
- Experience with cloud platforms (AWS, Azure, or GCP)
Benefits & conditions
- Flexible PTO + all Federal holidays off
- Health, dental and vision insurance plans
- Flexible Spending Account (FSA)
- 401k with employer match
- Company-sponsored life insurance, short- and long-term disability
- Professional development (training, certifications, conferences)
- Paid cloud developer accounts
- Referral bonuses
- HQ office perks (parking / metro reimbursement, nitro coffee & lunches)
- Annual social events (540 Week, hackathon, charity golf tournament, etc.)
- Access to 540’s Washington Capitals & Nationals tickets
About the company
540 is seeking a Senior Data Engineer to support mission-critical financial analytics initiatives within the DoW, including work on the War Data Platform ((WDP) formerly Advana) and broader warfighter data environments.
In this role, you’ll design and deliver end-to-end data solutions that power financial management and operational decision-making across complex DoW systems. You’ll work across Databricks and Palantir Foundry environments to build scalable data pipelines, develop production-grade data products, enable advanced analytics, and AI workflows for mission stakeholders.
This is a hands-on technical leadership role ideal for someone who thrives in complex data environments, enjoys working directly with users, and can translate real-world requirements into scalable data solutions.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Making Data Warehouses Fast: A Developer’s Story
Fully Remote Software Engineer Jobs
Data Analyst Salary in the UK