Databricks Data Engineer

Peraton Inc
United States
1 day ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$112,000.0 - $179,000.0
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Microsoft Azure Big Data Business Systems Cloud Computing Continuous Integration Data Dictionary Data Governance Data Structures Apache Hive Python (Programming Language)
+15 more
Meta-Data Management Enterprise Software Applications Data Ingestion Git Data Lakes Pyspark Infrastructure Automation Frameworks Data Lineage Optimization Algorithms Enterprise Integration Machine Learning Operations Tools for Reporting Data Pipelines Legacy Systems Databricks

Job description

The Databricks Data Engineer will be responsible for the hands-on build-out of a Government-owned Databricks workspace and the data ingestion/integration work needed to consolidate agency business system data. This includes designing and implementing data pipelines from core enterprise systems, implementing Unity Catalog for data governance, configuring MLflow for machine learning workflows, and developing comprehensive documentation to support sustainment beyond the pilot.

This role is 100% Remote.

Other Responsibilities Include:

  • Build out and configure a dedicated Government workspace within the existing Databricks environment
  • Design and implement data ingestion pipelines from core agency business systems including financial, HR, CRM, and ITSM systems
  • Leverage native/built-in connectors where source systems support them; design custom integration approaches for legacy systems
  • Normalize and prepare ingested data within Databricks for consumption by downstream visualization/reporting tools
  • Implement Databricks Unity Catalog for centralized data governance, metadata management, active auditing, and end-to-end lineage tracking
  • Review current configuration, assess security controls for CUI/PII/PHI/financial data, and implement improvements
  • Develop comprehensive ā€œas-builtā€ documentation including physical/logical architecture diagrams, automated data dictionaries, and SOPs
  • Document data sources, integration methods, and data lake architecture decisions to support sustainment

Requirements

  • 5 years work experience with BS/BA; 3 years with MS/MA
  • US Citizenship
  • Active DoD Secret clearance
  • 2 years working on the Databricks platform
  • Strong proficiency in PySpark, Spark SQL, and Python for large-scale data processing and pipeline development
  • Hands-on experience with Unity Catalog administration, including metastore management, access policies, and data lineage
  • Experience with pipeline orchestration tools (Airflow, Databricks Workflows)
  • Experience with Delta Lake, schema evolution, time travel, and optimization techniques
  • Experience integrating heterogeneous enterprise systems, including legacy/custom integrations
  • Familiarity with cloud platforms (Azure/AWS) and infrastructure-as-code practices
  • Understanding of data governance principles, compliance frameworks, and CUI/PII handling practices
  • Familiarity with financial, HR, CRM, or ITSM data structures
  • Git/CI-CD pipeline experience
  • DoD 8570 certification, * Databricks Certified Data Engineer Associate or Professional certification

Benefits & conditions

Target Salary Range: $112,000 - $179,000. This represents the typical salary range for this position. Salary is determined by various factors, including but not limited to, the scope and responsibilities of the position, the individual’s experience, education, knowledge, skills, and competencies, as well as geographic location and business and contract considerations. Depending on the position, employees may be eligible for overtime, shift differential, and a discretionary bonus in addition to base pay.

Benefits Statement: Peraton offers eligible employees a variety of benefits including medical, dental, vision, life, health savings account, short/long term disability, EAP, parental leave, 401(k), paid time off (PTO) for vacation, and company paid holidays. A full listing of available benefits can be viewed at https://www.careers.peraton.com/benefits.

About the company

Peraton is a next-generation national security company that drives missions of consequence spanning the globe and extending to the farthest reaches of the galaxy. As the world’s leading mission capability integrator and transformative enterprise IT provider, we deliver trusted, highly differentiated solutions and technologies to protect our nation and allies. Peraton operates at the critical nexus between traditional and nontraditional threats across all domains: land, sea, space, air, and cyberspace. The company serves as a valued partner to essential government agencies and supports every branch of the U.S. armed forces. Each day, our employees solve the most daunting challenges that our customers face. Visit peraton.com to learn how we’re keeping people around the world safe and secure.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.clearancejobs.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon Ā· World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy Ā· LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer Ā· Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou Ā· Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph Ā· LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy Ā· World Congress 2024

Videos

See all

Related articles

See all