> Markdown version of [/jobs/ext/2249315-technical-lead-databricks](https://www.wearedevelopers.com/jobs/ext/2249315-technical-lead-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Technical Lead - DataBricks - **Company:** Wipro Limited - **Location:** Dallas, TX, United States - **Experience:** Expert - **Salary:** $60,000.0 - $135,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Amazon S3, Microsoft Azure, Cloud Storage, Code Review, Continuous Integration, Data Validation, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Warehousing, DevOps, Apache Hive, JSON, Python (Programming Language), Performance Tuning, Query Optimization, Role-Based Access Control, Release Management, Cloud Services, Simple Data Format, Software Deployment, SQL Databases, Data Streaming, Workflow Management Systems, Parquet, Data Logging, Data Processing, Cloud Platform System, Azure Data Factory, Apache Spark, Software Troubleshooting, Caching, Git, Data Lakes, Pyspark, Avro, Data Lakehouse, Data Pipelines, Databricks - **Published:** August 26, 2026 - **Apply:** https://www.careerjet.com/job/usb890903e4eb74d57d7c083ed90d315bf/eaa ## About the Role * Strong hands-on experience in Databricks development, including notebooks, workflows, jobs, clusters, Delta Lake, and Unity Catalog. * Advanced programming experience in PySpark, Python, Spark SQL, and SQL. * Strong understanding of data engineering concepts, data warehousing, data lakehouse architecture, ETL/ELT design, and data modeling. * Experience in building scalable data pipelines on cloud platforms such as Azure, AWS, or GCP. * Hands-on experience with orchestration tools such as Azure Data Factory, Airflow, Databricks Workflows, or similar tools. * Experience working with file formats such as Parquet, Avro, JSON, CSV, and Delta format. * Good understanding of performance tuning techniques including partitioning, caching, broadcast joins, cluster sizing, compaction, and query optimization. * Experience with CI/CD, Git, DevOps practices, release management, and environment migration. * Strong troubleshooting, analytical, problem-solving, and communication skills. * Experience with Delta Live Tables, Structured Streaming, Auto Loader, Unity Catalog, and Databricks SQL. * Exposure to data governance, lineage, cataloging, masking, encryption, and role-based access control. * Experience in migration from legacy ETL tools or on-premise data warehouses to Databricks lakehouse platform. * Knowledge of cloud storage services such as ADLS, Blob Storage, S3, or Google Cloud Storage. * Experience in BFSI, healthcare, retail, or large enterprise data platform environments is an added advantage. * Databricks, Azure, AWS, or data engineering certifications are preferred. Mandatory Skills: DataBricks - Data Engineering . Experience: 5-8 Years . ## Description We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser's local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any time whether you accept cookies or choose to opt out of cookies to improve website's performance, as well as cookies used to display content tailored to your interests. Your experience of the site and the services we are able to offer may be impacted if you do not accept all cookies. Modify Cookie Preferences Accept All Cookies Search Jobs, We are looking for a highly skilled and hands-on Databricks Lead Data Engineer to design, build, optimize, and manage scalable data engineering solutions using Databricks, Apache Spark, PySpark, SQL, and cloud-based data platforms. The ideal candidate should have strong technical leadership capabilities along with deep hands-on experience in developing production-grade data pipelines, lakehouse architectures, and enterprise data solutions., * Lead the design, development, and implementation of scalable data pipelines and data lakehouse solutions using Databricks, PySpark, Spark SQL, and Delta Lake. * Work hands-on in building batch and streaming ETL/ELT pipelines from multiple source systems into cloud data platforms. * Design and implement medallion architecture layers such as Bronze, Silver, and Gold for efficient data processing and analytics consumption. * Optimize Spark jobs, Databricks notebooks, clusters, workflows, and SQL queries for performance, reliability, and cost efficiency. * Collaborate with business stakeholders, architects, data analysts, and data scientists to understand requirements and translate them into robust technical solutions. * Provide technical leadership, code reviews, best practices, and mentoring support to junior and mid-level data engineers. * Implement data quality checks, data validation rules, monitoring, logging, error handling, and restartability mechanisms. * Ensure adherence to data governance, security, access control, and compliance standards across data engineering solutions. * Support production deployments, troubleshoot pipeline failures, perform root cause analysis, and drive continuous improvement., Description: JOB SUMMARY The Technical Buyer is responsible for sourcing, purchasing, and managing supply of technical and engineered components, materials, and services requir… + 4 days ago ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Why Attend a Developer Event in 2026?](https://www.wearedevelopers.com/magazine/688-why-attend-a-developer-event-in-2026)