> Markdown version of [/jobs/ext/2495801-lead-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/2495801-lead-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - Databricks - **Company:** Nava Software Solutions LLC - **Location:** Houston, TX, United States - **Experience:** Expert - **Salary:** $160,200.0 - $195,800.0 - **Contract:** Temporary to permanent - **Skills:** Artificial Intelligence, Amazon Web Services, Architectural Patterns, Cloud Database, Databases, Data Architecture, Data Governance, Data Transformation, Data Systems, Python (Programming Language), PostgreSQL, Meta-Data Management, Microsoft Visual Studio, Microsoft SQL Server, SQL Azure, Oracle (Applications), Power BI, Service-Oriented Architecture, PL-SQL, SQL Databases, Teradata SQL, Transact-SQL, Data Strategy, Git, Powerquery, Data Layers, Pandas, Data Lakes, Pyspark, Information Technology, Data Lineage, AWS Glue, Data Management, Machine Learning Operations, Cloud Migration, SQL Server Management Studio (SSMS), Software Version Control, Databricks - **Published:** August 1, 2026 - **Apply:** https://www.careerjet.com/jobad/us35ec3071a2709ad92814f121b469065c ## About the Role * Bachelor's or Master's degree in Computer Science, Engineering, or related field. * 7 10 years of implementation experience in cloud data architecture, with at least 5 years in AWS environments. * Proficiency in AWS services: Glue, Redshift, Athena, Lake Formation, SageMaker, Bedrock, Step Functions. * Extensive experience working with Databricks. * Working knowledge of the Alation data governance tool. * Strong skills in SQL (T-SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL. * Experience with databases: SQL Server, Oracle, PostgreSQL, Azure SQL, Teradata. * Skilled in Power BI, Git, Visual Studio Code, SSMS. * Knowledge of architectural patterns: Medallion architecture, data mesh, Lakehouse, SOA data layers. * AWS and Databricks certifications are preferred. * Excellent communication, collaboration, and leadership abilities. Preferred Experience * Leading cloud migration and data modernization initiatives. * Designing and implementing scalable data architectures in AWS and Databricks. * Managing data governance, security, and compliance in complex environments. * Mentoring junior architects and engineers. * Working with cross-functional teams to deliver business value through data. ## Description The Lead Data Engineer is responsible for defining, implementing, and overseeing enterprise-wide data architecture strategies that align with business objectives. This role requires deep expertise in cloud platforms (especially AWS), advanced data modeling, and the ability to lead modernization initiatives across the organization. Key Responsibilities * Develop and execute long-term data architecture vision in alignment with business goals. * Design and implement scalable data systems, including Data Lakes, Lakehouse, and Data Mesh architecture. * Lead cloud migration strategies and data modernization projects. * Collaborate with business and technology stakeholders to ensure architectural alignment. * Architect and optimize batch and streaming data pipelines using appropriate tools such as AWS Glue. * Implement data governance, metadata management, lineage tracking, and compliance frameworks. * Integrate data platforms to support AI/ML workflows (SageMaker, Bedrock, Databricks). * Provide technical leadership, mentorship, and oversight for data analysts and engineers. * Conduct technical assessments and facilitate stakeholder workshops. * Ensure best practices in version control, automation, and documentation., * This role may require occasional travel for stakeholder workshops or technical assessments. * The Senior Data Engineer will play a key role in shaping the organization's data strategy and future readiness for AI/ML initiatives., Job Title: ADF Data Engineer Work Location: Houston, TX 77079 - Hybrid (4 Days Onsite a week at client location) Contract duration: 6+ months Interview: Virtual We need 1… + 7 days ago, Phillips 66 & YOU - Together we can fuel the future We are seeking a Lead Engineer, Data & AI Governance, to serve as a technical lead and subject matter expert supporting the de… + 9 days ago, Join the ECI Group's Professional Technical Services Network as a contract Sr Data Engineer. This is a Houston based contract role with an anticipated 4-month duration with an est… + 10 days ago + Apply easily + ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Getting to Know Your Legacy (System) with AI-Driven Software Archeology](https://www.wearedevelopers.com/videos/1437-getting-to-know-your-legacy-system-with-ai-driven-software-archeology) - [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)