> Markdown version of [/jobs/ext/491847-databricks-sme](https://www.wearedevelopers.com/jobs/ext/491847-databricks-sme). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Databricks SME

- **Company:** Agelix Consulting
- **Location:** Washington, DC, United States
- **Experience:** Expert
- **Salary:** $78,000.0 - $157,000.0
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Amazon S3, Cloud Computing, Code Review, Information Engineering, Data Governance, Identity and Access Management, Python (Programming Language), SQL Databases, Cloud Platform System, Amazon Virtual Private Cloud (VPC), Data Lakes, Data Lineage, Data Analytics, Data Pipelines, Databricks
- **Published:** June 7, 2026
- **Apply:** https://www.careerjet.com/jobad/us6e22aee68d1fbaf092851faa24758ec1

## About the Role

* 8+ years of hands-on experience in cloud technology environments.
 * 3 5 years of dedicated Databricks experience including workspace administration and optimization.
 * Proven expertise as a Databricks SME with Unity Catalog, Delta Lake, and cluster management.
 * Strong proficiency with AWS services including S3, IAM, Glue, Redshift, and VPC networking.
 * Experience with data governance frameworks and security controls in cloud environments.
 * Proficiency in Python, Scala, or SQL for data engineering tasks.
 * Familiarity with federal IT compliance standards (FedRAMP, FISMA) preferred.
 * Knowledge of tax-processing or financial data management systems is highly preferred.
 * Databricks Certified Data Engineer Professional certification preferred.
 * AWS Certified Data Analytics or Solutions Architect certification preferred.

## Description

* Serve as the Databricks SME and guide technical decisions for workspace architecture design, configuration, and optimization.
 * Lead governance processes within Databricks environments, including access controls, data lineage, and workspace policies.
 * Optimize Databricks cluster and job performance; identify and resolve bottlenecks in data pipelines.
 * Design and implement secure integration patterns between Databricks and AWS services (e.g., S3, IAM, Glue, Redshift).
 * Perform specialized operations including Delta Lake management, Unity Catalog administration, and MLflow tracking.
 * Collaborate with government technical leads on architecture reviews and platform enhancement initiatives.
 * Develop and maintain technical documentation, runbooks, and best practice guidelines.
 * Support platform security requirements and ensure compliance with IRS/Treasury policies.
 * Mentor mid-level engineers and contribute to team knowledge sharing.
 * Participate in code reviews, design discussions, and agile ceremonies.


## Related Videos

- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed)
- [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters)