> Markdown version of [/jobs/ext/2118792-lead-software-engineer-databricks-platform-engineer](https://www.wearedevelopers.com/jobs/ext/2118792-lead-software-engineer-databricks-platform-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Software Engineer (Databricks Platform Engineer) - **Company:** Vizient, Inc. - **Location:** Minneapolis, MN, United States - **Experience:** Expert - **Salary:** $117,600.0 - $206,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Data Analysis, Microsoft Azure, Cloud Computing, Cloud Engineering, Information Systems, Information Engineering, Machine Learning, Search Technologies, Data Streaming, Apache Spark, Event Driven Architecture, Data Lakes, Infrastructure Automation Frameworks, Information Technology, Data Management, Machine Learning Operations, Terraform, Databricks - **Published:** August 19, 2026 - **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/17980461?backUrl=%2Fcareer%2F17980461%2FLead-Software-Engineer-Databricks-Platform-Engineer-Minnesota-Edina ## About the Role * Relevant degree preferred. Advanced degree in Computer Science, Engineering, Information Systems, or a related field preferred. * 7 or more years of relevant experience required. * 3 or more years of hands-on experience designing, implementing, and supporting Databricks platform solutions required. * Strong experience with Azure cloud services, cloud-native architectures, and enterprise platform engineering required. * Experience with Terraform, Infrastructure-as-Code, and CI/CD pipelines, and infrastructure automation. * Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architectures. * Experience developing reusable platform services, automation frameworks, self-service capabilities, and engineering accelerators. * Experience supporting machine learning and AI platform capabilities, including MLflow, Model Registry, Feature Store, Vector Search, or MLOps practices preferred. * Databricks certification, experience with streaming and event-driven architectures, enterprise-scale data platforms, or healthcare industry experience preferred. ## Description In this role, you will lead the design, engineering, and evolution of the enterprise Databricks platform as a strategic capability that enables analytics, data products, machine learning, and AI solutions across the organization. You will develop reusable platform services, automation frameworks, reference architectures, and self-service capabilities that accelerate delivery while aligning with enterprise architecture, governance, and engineering standards. You will collaborate with cross-functional teams to enhance developer experience, drive platform adoption, evaluate emerging technologies, and deliver scalable, secure, and cost-effective healthcare data and AI solutions., * Lead the design, implementation, and continuous evolution of the enterprise Databricks platform and supporting architecture. * Develop reusable platform services, reference architectures, engineering standards, and implementation patterns for analytics, data products, streaming, and AI workloads. * Build Infrastructure-as-Code, CI/CD pipelines, and automation frameworks to improve platform scalability, reliability, and operational efficiency. * Create self-service capabilities, reusable templates, and engineering accelerators that simplify platform onboarding and deployment. * Optimize platform performance, scalability, security, governance, and cost efficiency across cloud environments. * Enable machine learning and AI platform capabilities by implementing patterns for MLflow, Model Registry, Feature Store, Vector Search, and other Databricks technologies. * Partner with Enterprise Architecture, Data Engineering, Product Management, Cloud Engineering, Data Science, and client stakeholders to deliver enterprise platform capabilities. * Evaluate emerging Databricks features and cloud technologies, lead proof-of-concepts, and recommend platform enhancements that support business objectives. * Provide technical leadership, mentoring, and engineering guidance while promoting Platform-as-a-Product principles and engineering best practices. * Drive continuous improvement through automation, innovation, and adoption of enterprise platform standards. ## Related Videos - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)