Sr. Azure Databricks Data Engineer / Architect

Cognizant Technology Solutions Corporation
San Francisco, CA, United States
3 days ago
Apply on www.sanfranciscogigs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$100,000.0 - $117,000.0
Working hours
Regular working hours

Tech stack

Business Analytics Applications Microsoft Azure Big Data Cloud Computing Cloud Database Information Systems Continuous Integration Information Engineering Data Governance Data Infrastructure Data Systems Data Warehousing
+18 more
Relational Databases Identity and Access Management Python (Programming Language) Key Management Performance Tuning Query Optimization Standard Sql Azure Data Factory Microsoft Fabric Data Lakes Pyspark Information Technology Deployment Automation Data Analytics Enterprise Integration Software Version Control Data Pipelines Databricks

Job description

As a Senior Azure Databricks Data Engineer / Architect , you will make an impact by designing and delivering scalable cloud-based data platform solutions that enable enterprise analytics, reporting, and data-driven decision-making. You will be a valued member of the Data Engineering team and work collaboratively with product owners, data engineers, business analysts, and other stakeholders to deliver secure, high-performing data solutions on Azure., * Design and architect end-to-end data platform solutions using Azure Databricks, Azure Data Services, and modern cloud technologies.

  • Build and optimize scalable data pipelines using Python and PySpark to ingest, transform, and validate large volumes of data.
  • Configure and administer Databricks environments, including workspace management, security, access controls, and cluster optimization.
  • Develop and maintain data models, Databricks SQL queries, and analytics solutions that support reporting and business intelligence initiatives.
  • Implement CI/CD and data platform best practices using Azure DevOps while ensuring data quality, governance, performance, and operational reliability.

Work model

We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a hybrid position requiring 1-2 days per week in a client or Cognizant office in Irvine, California . Regardless of your working arrangement, we are here to support a healthy work-life balance through our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

Requirements

  • Strong experience with Azure Databricks and PySpark in enterprise-scale data engineering environments.
  • Hands-on experience with Azure Data Factory (ADF) and cloud-based data integration solutions.
  • Experience working with Oracle Data Integrator (ODI) and relational database technologies.
  • Strong SQL and PL/SQL development skills with expertise in performance tuning and query optimization.
  • Experience designing and maintaining data lakes, data pipelines, and cloud-based analytics platforms on Microsoft Azure.
  • Proficiency with Azure DevOps, version control, CI/CD methodologies, and automated deployment practices.
  • Experience implementing data governance, security controls, and access management using services such as Azure Key Vault.
  • Strong communication and stakeholder management skills with the ability to translate business requirements into technical solutions.
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent professional experience.

These will help you stand out

  • Experience with Microsoft Fabric and modern analytics platforms.
  • Knowledge of data modeling, data warehousing, and lakehouse architectures.
  • Experience supporting automotive industry data and analytics initiatives.
  • Familiarity with Databricks Workflows, job orchestration, and monitoring frameworks.
  • Experience driving architecture standards, technical governance, and cloud modernization initiatives.

We’re excited to meet people who share our mission and can make an impact in a variety of ways. Don’t hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.

Benefits & conditions

The annual salary for this position is between $ 100,000 - $ 117,000 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

Medical/Dental/Vision/Life Insurance

Paid holidays plus Paid Time Off

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.sanfranciscogigs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

Videos

See all

Related articles

See all