Data Engineer / Azure Databricks Engineer - Senior

Nationwide IT Services, Inc
Joint Base Andrews, MD, United States
19 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$150,000.0 - $188,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Microsoft Azure Information Systems Databases Continuous Integration Information Engineering Extract Transform Load (ETL) Python (Programming Language) Performance Tuning Runbook SQL Databases Data Streaming
+8 more
Systems Integration Azure Data Factory Git Information Technology Data Lineage Software Version Control Data Pipelines Databricks

Job description

  • Design, develop, test, deploy, maintain, and optimize scalable ETL/ELT pipelines and Databricks workloads.
  • Develop SQL and Python transformations, notebooks, jobs, and orchestration routines for scheduled and event-driven processing.
  • Implement automated data-quality checks, reconciliation controls, exception handling, quarantine processes, and recovery procedures.
  • Create and maintain source-to-target mappings, data lineage, technical documentation, operating procedures, and runbooks.
  • Integrate APIs, files, databases, and cloud data services across DAF, ANG, DoD, and CDAO platforms.
  • Implement Git-based version control, CI/CD automation, testing, monitoring, alerting, and controlled releases.
  • Tune pipeline and repository performance to support availability, execution-success, data-currency, and response-time objectives., + $105,000-245,000 per year Description Are you eager to architect and deliver robust, scalable, and secure software systems that enable real operational decisions for warfighters? Are you excited to dire…

  • 3 days ago

Requirements

  • 8+ years of relevant professional experience.
  • Bachelor’s degree in computer science, Data Engineering, Information Systems, Engineering, or a related field.
  • Advanced hands-on proficiency with SQL, Python, Azure Databricks, and Azure data engineering services.
  • Experience with ETL/ELT orchestration, APIs, data-quality controls, monitoring, troubleshooting, and performance tuning.
  • Experience using Git and CI/CD practices to test and promote data-engineering code.
  • Ability to document complex data flows, mappings, dependencies, and operating procedures.
  • Must satisfy applicable DoD/DAF security, cybersecurity-awareness, CUI, OPSEC, and access-training requirements.

Preferred Qualifications

  • Microsoft Azure or Databricks certification.
  • Experience integrating DoD or DAF source systems.
  • Familiarity with defense HR, financial, logistics, readiness, or maintenance data.

Benefits & conditions

Our benefits package includes medical, dental, and vision insurance, life and disability insurance, a 401(k) plan with employer match, paid holidays, PTO (sick/vacation), commuter benefits, employee assistance program (EAP), educational reimbursement, and pet insurance. Salary range $150,000 to $188,000 annually The salary range is a general guideline. We consider several factors when determining base salary offers, including the position’s scope and responsibilities, the candidate’s experience, education, and skills, and current market conditions. Powered by JazzHR

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

2:50 min

Introduction and the value of runbooks

Hila Fish · World Congress 2023

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · World Congress 2022

Videos

See all

Related articles

See all