> Markdown version of [/jobs/ext/3066439-databricks-data-engineer](https://www.wearedevelopers.com/jobs/ext/3066439-databricks-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Data Engineer - **Company:** Vital Tech Solutions - **Location:** Washington, DC, United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Databases, Continuous Integration, Data Validation, Information Engineering, Data Integration, Python (Programming Language), SQL Databases, Data Streaming, Unstructured Data, Apache Spark, Git, Data Layers, Pyspark, Information Technology, Apache Kafka, Video Streaming, Databricks - **Published:** September 25, 2026 - **Apply:** https://www.juju.com/job/16_6f4ff8a9 ## About the Role * Active Secret security clearance or higher is required. * 5+ years of professional data engineering experience. * 2+ years of hands-on Databricks experience. * Strong production-level experience with PySpark and SQL. * Experience developing both batch and streaming data pipelines. * Strong understanding of data modeling and modern data architecture principles. * Proficiency with Python. * Experience working within Git-based development and CI/CD environments. * Familiarity with Databricks Unity Catalog, including catalogs, schemas, and permissions from a data engineering perspective. * Experience integrating data from multiple source types, including databases, APIs, files, and streaming platforms. Preferred Qualifications * Experience with Databricks Delta Live Tables. * Experience with Databricks Workflows. * Experience with Kafka, Kinesis, or similar streaming technologies. * Experience working within federal, regulated, or security-sensitive environments. * Bachelor's degree in Computer Science, Engineering, Information Technology, or a related discipline. ## Description Our client, a growing technology services organization supporting federal government programs, is seeking an experienced Databricks Data Engineer to support a federal technology initiative. This is a remote opportunity available to U.S. citizens residing in the United States. Candidates must currently hold an ACTIVE Secret security clearance or higher. Candidates without an active Secret-level clearance cannot be considered. The ideal candidate will bring strong hands-on data engineering experience within Databricks, including development of production-grade batch and streaming pipelines, PySpark and SQL transformations, data modeling, ingestion frameworks, and modern data architecture practices. Responsibilities * Design, build, and maintain batch and streaming data pipelines using PySpark, SQL, Databricks Workflows, and Delta Live Tables. * Implement Medallion Architecture across bronze, silver, and gold data layers to support data quality, transformation, and consumption. * Develop scalable ingestion frameworks for structured, semi-structured, and unstructured data. * Integrate data from files, databases, APIs, and streaming sources such as Kafka, Kinesis, and Databricks Auto Loader. * Design dimensional and domain-specific data models supporting analytics and downstream applications. * Build and consume APIs for integration with downstream systems. * Optimize Spark workloads for performance and cost through partitioning, caching, cluster sizing, and related techniques. * Develop and implement data quality checks, validation processes, and pipeline monitoring. * Maintain documentation covering data flows, lineage, architecture, and integration points. * Collaborate with engineering, platform, architecture, and federal program stakeholders throughout the development lifecycle. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Branch your database like your code: How schema changes and pull requests go hand in hand](https://www.wearedevelopers.com/videos/350-branch-your-database-like-your-code-how-schema-changes-and-pull-requests-go-hand-in-hand) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)