> Markdown version of [/jobs/ext/1110977-databricks-engineer](https://www.wearedevelopers.com/jobs/ext/1110977-databricks-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Engineer - **Company:** Bounteous, Inc. - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $91,000.0 - $119,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Data Analysis, Microsoft Azure, Code Review, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Warehousing, Cursor (Graphical User Interface Elements), Information Lifecycle Management, Python (Programming Language), Search Technologies, Workflow Management Systems, Cloud Platform System, GitHub Copilot, Large Language Models, Snowflake, Prompt Engineering, Apache Spark, Caching, Generative AI, Data Lakes, Pyspark, Core Data, Information Technology, Data Analytics, Machine Learning Operations, Stream Processing, Code Restructuring, Software Version Control, Data Pipelines, Databricks - **Published:** June 20, 2026 - **Apply:** https://www.builtincolorado.com/job/senior-databricks-engineer/9835928 ## About the Role * 5+ years of data engineering experience, with 3+ years building production solutions on Databricks and Apache Spark. * Expert proficiency in Python (PySpark) and advanced SQL. * Deep hands-on experience with Delta Lake, Unity Catalog, and the medallion architecture pattern. * Strong experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services. * Proven track record optimizing Spark performance and managing cluster cost. * Experience with data modeling, warehousing concepts, and building dimensional/analytics-ready datasets. * Proficiency with Git-based version control, CI/CD, and infrastructure-as-code. * Bachelor's degree in Computer Science, Engineering, or equivalent practical experience., * Databricks certification (Data Engineer Associate/Professional). * Experience with Delta Live Tables, structured streaming, and real-time data processing. * Familiarity with MLflow and supporting machine learning workflows in production. * Experience with orchestration tools (Airflow, dbt) and data observability platforms. * Exposure to data governance, security, and compliance frameworks (e.g., GDPR, HIPAA, SOC 2). * Hands-on experience using AI coding assistants (e.g., Claude Code, GitHub Copilot, Cursor) to accelerate development, refactoring, and code review. * Familiarity with large language model APIs and SDKs (e.g., Anthropic Claude, OpenAI) and prompt engineering for data and analytics use cases. * Experience integrating GenAI capabilities into data pipelines or applications, including retrieval-augmented generation (RAG) and vector search. * Awareness of responsible AI practices, including evaluation, guardrails, and cost/latency trade-offs when deploying LLM-based solutions. ## Description Design, build, and optimize production Databricks Lakehouse data pipelines using PySpark, Spark SQL, and Delta Lake. Implement medallion architectures, Unity Catalog governance, CI/CD, and cluster optimization. Collaborate with data science and analytics teams, mentor engineers, monitor production, and drive security, compliance, and performance improvements., * Promote and enforce awareness of key information security practices, including acceptable use of information assets, malware protection, and password security protocols * Identify, assess, and report security risks, focusing on how these risks impact the confidentiality, integrity, and availability of information assets * Understand and evaluate how data is stored, processed, or transmitted, ensuring compliance with data privacy and protection standards (GDPR, CCPA, etc.) * Ensure data protection measures are integrated throughout the information lifecycle to safeguard sensitive information Role and Responsibilities: * Architect, build, and maintain scalable ETL/ELT pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL, and Delta Lake. * Design and implement medallion (bronze/silver/gold) data architectures and enforce data quality, governance, and lineage standards. * Optimize Spark jobs and cluster configurations for performance and cost, including partitioning, caching, and autoscaling strategies. * Implement and manage Unity Catalog for access control, data governance, and cross-workspace asset sharing. * Build and orchestrate workflows using Databricks Workflows, Delta Live Tables, and CI/CD pipelines. * Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable data products. * Establish engineering best practices, conduct code reviews, and mentor junior data engineers. * Monitor production pipelines, troubleshoot failures, and drive root-cause analysis and continuous improvement. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [HTTP headers that make your website go faster](https://www.wearedevelopers.com/videos/1676-http-headers-that-make-your-website-go-faster) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)