Databricks Lead
Role details
Job location
Tech stack
Job description
The Databricks Lead will drive the design, development, and optimization of data engineering solutions on Azure. This role requires deep expertise in Databricks, PySpark, Python, and Azure Data Lake, along with strong ownership and the ability to deliver independently. The lead will guide technical direction, ensure platform excellence, and support enterprise analytics initiatives.
In this role, you will:
- Lead architecture and development of scalable data solutions using Databricks and Azure Data Lake.
- Build and optimize PySpark pipelines and Databricks SQL workloads.
- Drive best practices for cluster management, CI/CD, governance, and performance tuning.
- Collaborate with cross-functional teams to translate business needs into technical solutions.
- Ensure security, compliance, and operational reliability across data platforms.
- Mentor junior engineers and promote engineering excellence.
- Document architecture, patterns, and operational processes.
- Onsite / offshore co-ordination.
Work model: Hybrid
We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role's business requirements, this is a hybrid position requiring 4 days a week in a client or Cognizant office in Charlotte, NC or Short Hill, NJ. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.
The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.
Requirements
- 8+ years in IT related role
- Databricks (SQL, Notebooks, Workflows), PySpark, Python
- Azure cloud stack (ADLS, ADF, DevOps)
- Strong problem-solving, accountability, and independent execution
- Excellent communication and stakeholder engagement
Benefits & conditions
The annual salary for this position is between $180,000- $115,000 USD depending on experience and other qualifications of the successful candidate.
This position is also eligible for Cognizant's discretionary annual incentive program, based on performance and subject to the terms of Cognizant's applicable plans.
Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
- Medical/Dental/Vision/Life Insurance
- Paid holidays plus Paid Time Off
- 401(k) plan and contributions
- Long-term/Short-term Disability
- Paid Parental Leave
- Employee Stock Purchase Plan
Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law
