> Markdown version of [/jobs/ext/2683347-sr-azure-databricks-data-engineer-architect](https://www.wearedevelopers.com/jobs/ext/2683347-sr-azure-databricks-data-engineer-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Azure Databricks Data Engineer / Architect - **Company:** Cognizant Technology Solutions Corporation - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Salary:** $100,000.0 - $117,000.0 - **Contract:** Permanent contract - **Skills:** Business Analytics Applications, Microsoft Azure, Big Data, Cloud Computing, Cloud Database, Information Systems, Continuous Integration, Information Engineering, Data Governance, Data Infrastructure, Data Systems, Data Warehousing, Relational Databases, Identity and Access Management, Python (Programming Language), Key Management, Performance Tuning, Query Optimization, Standard Sql, Azure Data Factory, Microsoft Fabric, Data Lakes, Pyspark, Information Technology, Deployment Automation, Data Analytics, Enterprise Integration, Software Version Control, Data Pipelines, Databricks - **Published:** September 2, 2026 - **Apply:** https://www.sanfranciscogigs.com/job.asp?id=3373897119&tx=KK2323FFP&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54 ## About the Role * Strong experience with Azure Databricks and PySpark in enterprise-scale data engineering environments. * Hands-on experience with Azure Data Factory (ADF) and cloud-based data integration solutions. * Experience working with Oracle Data Integrator (ODI) and relational database technologies. * Strong SQL and PL/SQL development skills with expertise in performance tuning and query optimization. * Experience designing and maintaining data lakes, data pipelines, and cloud-based analytics platforms on Microsoft Azure. * Proficiency with Azure DevOps, version control, CI/CD methodologies, and automated deployment practices. * Experience implementing data governance, security controls, and access management using services such as Azure Key Vault. * Strong communication and stakeholder management skills with the ability to translate business requirements into technical solutions. * Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent professional experience. These will help you stand out * Experience with Microsoft Fabric and modern analytics platforms. * Knowledge of data modeling, data warehousing, and lakehouse architectures. * Experience supporting automotive industry data and analytics initiatives. * Familiarity with Databricks Workflows, job orchestration, and monitoring frameworks. * Experience driving architecture standards, technical governance, and cloud modernization initiatives. We're excited to meet people who share our mission and can make an impact in a variety of ways. Don't hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role. ## Description As a Senior Azure Databricks Data Engineer / Architect , you will make an impact by designing and delivering scalable cloud-based data platform solutions that enable enterprise analytics, reporting, and data-driven decision-making. You will be a valued member of the Data Engineering team and work collaboratively with product owners, data engineers, business analysts, and other stakeholders to deliver secure, high-performing data solutions on Azure., * Design and architect end-to-end data platform solutions using Azure Databricks, Azure Data Services, and modern cloud technologies. * Build and optimize scalable data pipelines using Python and PySpark to ingest, transform, and validate large volumes of data. * Configure and administer Databricks environments, including workspace management, security, access controls, and cluster optimization. * Develop and maintain data models, Databricks SQL queries, and analytics solutions that support reporting and business intelligence initiatives. * Implement CI/CD and data platform best practices using Azure DevOps while ensuring data quality, governance, performance, and operational reliability. Work model We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role's business requirements, this is a hybrid position requiring 1-2 days per week in a client or Cognizant office in Irvine, California . Regardless of your working arrangement, we are here to support a healthy work-life balance through our various wellbeing programs. The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)