> Markdown version of [/jobs/ext/3550866-databricks-data-engineer](https://www.wearedevelopers.com/jobs/ext/3550866-databricks-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Databricks Data Engineer

- **Company:** NewGen Technologies
- **Location:** United States
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Amazon Web Services, Cloud Computing, Information Engineering, Extract Transform Load (ETL), Data Warehousing, Apache Hive, SQL Databases, Data Ingestion, IT Architecture, SC Clearance, Data Lakes, Pyspark, Databricks
- **Published:** September 30, 2026
- **Apply:** https://www.clearancejobs.com/jobs/9198747/databricks-data-engineer

## About the Role

* US Citizenship
 * Secret Clearance
 * Excellent interpersonal skills and ability in overseeing/prioritizing work requests
 * Excellent written and oral communication skills
 * Strong data engineering, ETL/ELT development, or data warehousing
 * Strong PySpark and/or Spark SQL skills; solid SQL fundamentals
 * Solid understanding of the Medallion Architecture (Bronze/Silver/Gold layering)
 * Proficiency with Delta Lake (ACID transactions, schema evolution, time travel, MERGE/Upsert patterns)
 * Experience designing both batch and incremental/streaming ingestion pipelines
 * Familiarity with the Agile process

Desired Skills

 * Databricks Certification/experience/familiarity preferred
 * Knowledge of and experience with the DoD
 * Familiar with Customer and/or DoD IT architectures
 * Federal experience
 * Experience in post go-live production support and break/fix
 * Focus on customer service and responsiveness, with sound customer handling skills
 * Experience working within AWS Gov Cloud
 * Experience working migrating code from non-accredited to accredited environments within AWS

## Description

* Build and maintain Databricks pipelines (60% of the time)
 * Gather and analyze requirements (20% of the time)
 * Monitor and troubleshoot data jobs (10% of the time)
 * Document processes and workflows (10% of the time)
 * Perform additional assigned tasks


## Related Videos

- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [The Data Mesh as the end of the Datalake as we know it](https://www.wearedevelopers.com/videos/156-the-data-mesh-as-the-end-of-the-datalake-as-we-know-it)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)