Technical Lead - DataBricks

We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website’s operation. Additionally, you can freely decide and change any time whether you accept cookies or choose to opt out of cookies to improve website’s performance, as well as cookies used to display content tailored to your interests. Your experience of the site and the services we are able to offer may be impacted if you do not accept all cookies. Modify Cookie Preferences Accept All Cookies Search Jobs, We are looking for a highly skilled and hands-on Databricks Lead Data Engineer to design, build, optimize, and manage scalable data engineering solutions using Databricks, Apache Spark, PySpark, SQL, and cloud-based data platforms. The ideal candidate should have strong technical leadership capabilities along with deep hands-on experience in developing production-grade data pipelines, lakehouse architectures, and enterprise data solutions., * Lead the design, development, and implementation of scalable data pipelines and data lakehouse solutions using Databricks, PySpark, Spark SQL, and Delta Lake.

• Work hands-on in building batch and streaming ETL/ELT pipelines from multiple source systems into cloud data platforms.
• Design and implement medallion architecture layers such as Bronze, Silver, and Gold for efficient data processing and analytics consumption.
• Optimize Spark jobs, Databricks notebooks, clusters, workflows, and SQL queries for performance, reliability, and cost efficiency.
• Collaborate with business stakeholders, architects, data analysts, and data scientists to understand requirements and translate them into robust technical solutions.
• Provide technical leadership, code reviews, best practices, and mentoring support to junior and mid-level data engineers.
• Implement data quality checks, data validation rules, monitoring, logging, error handling, and restartability mechanisms.
• Ensure adherence to data governance, security, access control, and compliance standards across data engineering solutions.
• Support production deployments, troubleshoot pipeline failures, perform root cause analysis, and drive continuous improvement., Description: JOB SUMMARY The Technical Buyer is responsible for sourcing, purchasing, and managing supply of technical and engineered components, materials, and services requir…
• 4 days ago

• Strong hands-on experience in Databricks development, including notebooks, workflows, jobs, clusters, Delta Lake, and Unity Catalog.
• Advanced programming experience in PySpark, Python, Spark SQL, and SQL.
• Strong understanding of data engineering concepts, data warehousing, data lakehouse architecture, ETL/ELT design, and data modeling.
• Experience in building scalable data pipelines on cloud platforms such as Azure, AWS, or GCP.
• Hands-on experience with orchestration tools such as Azure Data Factory, Airflow, Databricks Workflows, or similar tools.
• Experience working with file formats such as Parquet, Avro, JSON, CSV, and Delta format.
• Good understanding of performance tuning techniques including partitioning, caching, broadcast joins, cluster sizing, compaction, and query optimization.
• Experience with CI/CD, Git, DevOps practices, release management, and environment migration.
• Strong troubleshooting, analytical, problem-solving, and communication skills.
• Experience with Delta Live Tables, Structured Streaming, Auto Loader, Unity Catalog, and Databricks SQL.
• Exposure to data governance, lineage, cataloging, masking, encryption, and role-based access control.
• Experience in migration from legacy ETL tools or on-premise data warehouses to Databricks lakehouse platform.
• Knowledge of cloud storage services such as ADLS, Blob Storage, S3, or Google Cloud Storage.
• Experience in BFSI, healthcare, retail, or large enterprise data platform environments is an added advantage.
• Databricks, Azure, AWS, or data engineering certifications are preferred.

Mandatory Skills: DataBricks - Data Engineering . Experience: 5-8 Years .

The expected compensation for this role ranges from $60,000 to $135,000 .

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com., Final compensation will depend on various factors, including your geographical location, minimum wage obligations, skills, and relevant experience. Based on the position, the role is also eligible for Wipro’s standard benefits including a full range of medical and dental benefits options, disability insurance, paid time off (inclusive of sick leave), other paid and unpaid leave options. Applicants are advised that employment in some roles may be conditioned on successful completion of a post-offer drug screening, subject to applicable state law. Wipro provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Applications from veterans and people with disabilities are explicitly welcome. Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention. Apply now Start Please wait… Information at a Glance Get Job Alerts Receive notifications when we have open roles and get other relevant career news Join Us Explore open roles that match your interests and skills If you encounter any suspicious mail, advertisements, or persons who offer jobs at Wipro, please email us at . Do not email your resume to this ID as it is not monitored for resumes and career applications. Any complaints or concerns regarding unethical/unfair hiring practices should be directed to our Ombuds Group at . We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, caste, creed, religion, gender, marital status, age, ethnic and national origin, gender identity, gender expression, sexual orientation, political orientation, disability status, protected veteran status, or any other characteristic protected by law. Wipro is committed to creating an accessible, supportive, and inclusive workplace. Reasonable accommodation will be provided to all applicants including persons with disabilities, throughout the recruitment and selection process. Accommodations must be communicated in advance of the application, where possible, and will be reviewed on an individual basis. Wipro provides equal opportunities to all and values diversity. © 2026 Wipro Limited × Cookie Consent Manager When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer. Required Cookies These cookies are required to use this website and can’t be turned off. Required Cookies Show More Details Required Cookies Provider Description Enabled SAP as service provider We use the following session cookies, which are all required to enable the website to function:

• “route” is used for session stickiness
• “careerSiteCompanyId” is used to send the request to the correct data center
• “JSESSIONID” is placed on the visitor’s device during the session so the server can identify the visitor
• “Load balancer cookie” (actual cookie name may vary) prevents a visitor from bouncing from one instance to another

Cookies from provider SAPasserviceprovider are required and cannot be turned off Functional Cookies These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies. Consent to all Functional Cookies Show More Details Functional Cookies Provider Description Enabled YouTube YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos. Consent to cookies from provider YouTube Confirm My Choices Accept All Cookies This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections. This translation is generated by AI. Please excuse any imperfections.