> Markdown version of [/jobs/ext/3078861-telecommute-tech-lead-architect-databricks-data-engineering-ai-ml](https://www.wearedevelopers.com/jobs/ext/3078861-telecommute-tech-lead-architect-databricks-data-engineering-ai-ml). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # TELECOMMUTE Tech Lead/Architect - Databricks Data Engineering & AI/ML - **Company:** Gartner, Inc. - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Computing Platforms, Microsoft Azure, Big Data, Cloud Computing, Code Review, Computer Programming, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Security, Python (Programming Language), Machine Learning, Operational Databases, Performance Tuning, Cloud Services, DataOps, SQL Databases, Systems Integration, Workflow Management Systems, Google Cloud, Large Language Models, Apache Spark, Data Lakes, Pyspark, Git Flow, Machine Learning Operations, GPT, Software Version Control, Data Pipelines, Databricks - **Published:** September 25, 2026 - **Apply:** https://www.dice.com/job-detail/33dede26-eebc-494b-ade2-e28cd9eb0d58 ## About the Role We are seeking an experienced Tech Lead/Architect with strong hands-on expertise in Databricks, Data Engineering, and AI/ML to lead the design, development, and delivery of scalable data and AI solutions. The ideal candidate combines deep technical expertise with proven leadership skills, capable of guiding a team of engineers while remaining actively involved in architecture, coding, and problem-solving., * 8+ years of overall experience in data engineering, with 3+ years in a technical leadership or lead role. * Strong hands-on experience with Databricks, including: * Spark (PySpark/Scala), Delta Lake, Unity Catalog * Databricks Workflows/Jobs, Cluster management & optimization * Databricks SQL and performance tuning * Solid experience in Data Engineering, including: * Building and optimizing ETL/ELT pipelines at scale * Data modeling (batch and streaming) * Working with cloud data platforms (Azure/AWS/Google Cloud Platform - specify as needed) * Experience with orchestration tools (e.g., Airflow, ADF, Databricks Workflows) * Practical experience in AI/ML, including: * Building, training, and deploying ML models * Familiarity with GenAI/LLM frameworks (e.g., LangChain, RAG pipelines, vector databases) is a strong plus * MLOps practices for model lifecycle management * Strong programming skills in Python and SQL; familiarity with Scala is a plus. * Experience with CI/CD pipelines and version control (Git-based workflows). * Solid understanding of data security, governance, and compliance best practices. * Excellent communication and stakeholder management skills, with the ability to work directly with onshore clients/business teams. * Experience in the Life Sciences domain (pharma, biotech, clinical, or healthcare data) is preferred. * Proven experience leading and mentoring technical teams. * Strong ownership mindset with the ability to balance hands-on delivery and team leadership. * Excellent problem-solving and analytical thinking. * Strong communication skills to bridge technical and business conversations. * Ability to work independently in a fast-paced, onshore client-facing environment., * Databricks certification(s) (e.g., Databricks Certified Data Engineer Professional, Databricks Certified Machine Learning Professional). * Cloud certification (Azure/AWS/Google Cloud Platform). * Experience in Agile/Scrum delivery environments. * Prior experience working in client-facing consulting or professional services roles. ## Description EazyML, ( recognized by Gartner, specializes in Responsible AI. Our solutions enable proactive compliance and sustainable automation for enterprises adopting AI at scale. We're also associated with breakthrough startups like Amelia.ai, giving our team exposure to cutting-edge AI products at enterprise scale., * Lead the technical design and architecture of large-scale data engineering and AI/ML solutions on Databricks (Lakehouse Platform). * Provide hands-on technical leadership across the full data lifecycle: ingestion, transformation, storage, and consumption using Spark, Delta Lake, and Databricks workflows. * Design and implement scalable ETL/ELT pipelines, ensuring performance, reliability, and cost optimization. * Guide the team in building and deploying AI/ML models and GenAI/LLM-based solutions, integrating them into production data pipelines. * Collaborate with data scientists, ML engineers, and business stakeholders to translate requirements into robust technical solutions. * Establish and enforce best practices for data governance, security, CI/CD, and DataOps/MLOps within Databricks environments. * Mentor and coach a team of data engineers, conducting code reviews and driving engineering excellence. * Own technical decision-making, including platform architecture, tool selection, and performance tuning. * Act as the primary technical point of contact for client/stakeholder discussions, ensuring alignment between business goals and technical execution. * Stay current with evolving Databricks features, Delta Lake updates, and AI/GenAI trends, driving adoption of relevant innovations. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Blueprints for Success: Steering a Global Data & AI Architecture](https://www.wearedevelopers.com/videos/1577-blueprints-for-success-steering-a-global-data-ai-architecture) - [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Speak, Code, Deploy: Transforming Developer Experience with Voice Commands](https://www.wearedevelopers.com/videos/1159-speak-code-deploy-transforming-developer-experience-with-voice-commands) ## Related Articles - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)