> Markdown version of [/jobs/ext/525287-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/525287-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Databricks - **Company:** Data Inc - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Microsoft Azure, Big Data, Cloud Database, Continuous Integration, Data as a Services, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Data Security, Software Debugging, Distributed Computing Environment, PostgreSQL, MySQL, NoSQL, Data Processing, Google Cloud, Apache Spark, Backend, Data Lakes, Pyspark, Kubernetes, Infrastructure Automation Frameworks, Data Lakehouse, Data Delivery, Terraform, Software Version Control, Data Pipelines, Docker, Databricks - **Published:** June 10, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=16717406bf36c48a ## About the Role Do you have experience in Version control systems?, Do you have a Bachelor's degree?, * 5+ years of experience in data engineering or backend data infrastructure roles * 2+ years of hands-on experience with Databricks, Spark, or distributed data processing systems in a production environment * Deep proficiency with PySpark and Python for data engineering tasks * Experience with data modeling * Solid experience with Airflow, dbt, or other orchestration and transformation tools * Proven skills in data governance, lineage, or security best practices * Experience working with Azure (preferred), AWS, or Google Cloud * Strong working knowledge of CI/CD tools and version control workflows * Comfortable working with relational (e.g., PostgreSQL, MySQL) and NoSQL databases * Proven experience in monitoring, debugging, and scaling cloud-based data systems * Strong communication skills and ability to work independently in a remote team environment Kudos If You Have: * Experience with Kubernetes and Helm for deploying data workloads (not required) * Solid experience with Terraform or other Infrastructure as Code tools * Familiarity with containerization using Docker * Knowledge of data lakehouse architectures and Delta Lake * Experience working on Federal or government projects * Existing security clearance (preferred but not required) * Databricks Certification, * Bachelor's (Preferred) Experience: * data engineering: 7 years (Preferred) * Databricks: 3 years (Preferred) ## Description We are seeking a skilled and motivated Data Engineer with deep Databricks and cloud experience to support our Federal Services team. In this role, you will help design and implement scalable data solutions, build and optimize pipelines, and automate infrastructure within secure cloud environments. This role is ideal for experienced developers who enjoy tackling complex data engineering challenges, optimizing performance, and contributing to impactful government programs. You'll help shape robust, secure, and efficient pipelines that serve critical public-sector missions. Day-to-Day Impact * Design, develop, and optimize robust data pipelines in Databricks to process and transform large-scale data sets * Collaborate with data scientists, engineers, and cloud architects to build reliable, secure data systems * Automate infrastructure provisioning using Terraform and manage resources on Azure (or AWS/GCP) * Monitor, troubleshoot, and support production-grade data pipelines and jobs * Develop CI/CD workflows to streamline deployment and version control of data processing code * Ensure security, performance, and reliability across all stages of data workflow * Utilize and manage Docker containers where needed to deploy data services * Participate in Agile team ceremonies and help shape iterative data delivery plans * Support continuous improvement in data architecture, automation, and governance practices * Other duties as reasonably required ## Related Videos - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) - [Coding for Good: Achieving social change with an app](https://www.wearedevelopers.com/videos/1645-coding-for-good-achieving-social-change-with-an-app) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)