Data Engineer / Databricks Engineer-Senior

Position Summary Nationwide IT Services, NIS, is seeking a Senior Data Engineer / Databricks Engineer to design, build, test, deploy, optimize, and sustain enterprise data pipelines supporting the ANG CDAO data ecosystem for a potential opportunity. The engineer will work primarily with Azure Databricks, SQL, Python, Git-based CI/CD, and integrated DoD/DAF/ANG source systems to provide reliable ingestion, transformation, orchestration, data quality, monitoring, and technical documentation., * Design, build, test, deploy, and maintain automated and manual ETL/ELT pipelines supporting approximately 15-20 DAF, ANG, and DoD source systems.

• Implement ingestion patterns for structured, unstructured, API, batch, and streaming data; support near-real-time data currency requirements where applicable.
• Develop SQL and Python transformation logic to cleanse, standardize, deduplicate, validate, and enrich enterprise data in accordance with CDAO data standards and business rules.
• Build and operate Azure Databricks jobs, orchestration sequences, triggers, and workload schedules while optimizing execution performance and cloud-compute utilization.
• Implement automated data-quality checks, reconciliation controls, invalid-record quarantine, monitoring, logging, alerting, and recoverable error-handling patterns.
• Triage critical pipeline failures, perform root-cause analysis, and restore service within required response windows.
• Maintain pipeline code, configuration, infrastructure/deployment scripts, and test assets in the official Git repository and execute automated CI/CD build and security testing before release.
• Create and maintain data lineage, source-to-target mappings, architecture documentation, operational runbooks, and quarterly technical-documentation updates.
• Support data warehouse/lake administration, query optimization, Power BI dataflows, and secure cross-platform data movement as needed., MANTECH seeks a motivated, career-driven, and customer-focused Senior Network Engineer to join our team in Laurel, MD. You will play a critical role in supporting the enterprise …
• 5 days ago

• Demonstrated hands-on experience developing production-grade ETL/ELT pipelines using Azure Databricks or comparable Spark-based data platforms.
• Advanced SQL and Python skills for data transformation, validation, automation, troubleshooting, and performance optimization.
• Experience with batch and streaming ingestion, APIs, schema management, orchestration, monitoring, data quality, and failure recovery.
• Experience with Git-based version control and CI/CD practices for data-engineering solutions.
• Knowledge of data warehousing/lakehouse patterns, indexing/query optimization, access control, encryption, and secure handling of sensitive/CUI data.
• Must satisfy applicable DoD/DAF security, cybersecurity-awareness, CUI, OPSEC, and access-training requirements.

Preferred Qualifications

• Experience extracting and transforming data from DAF/DoD systems such as MILPDS, DCPDS, AFRISS, CHRIS, CMS, CRIS, GFEBS, DEAMS, REMIS, AROWS, M4S, iEMS, or Lockheed Martin Tableau.
• Experience integrating Databricks workloads with Palantir Foundry, Microsoft Azure, Advana/WDP, Power BI, or AskSage.

Our benefits package includes medical, dental, and vision insurance, life and disability insurance, a 401(k) plan with employer match, paid holidays, PTO (sick/vacation), commuter benefits, employee assistance program (EAP), educational reimbursement, and pet insurance. Salary range $125,000 to $178,000 annually The salary range is a general guideline. We consider several factors when determining base salary offers, including the position’s scope and responsibilities, the candidate’s experience, education, and skills, and current market conditions. Powered by JazzHR