Databricks Architect (Hybrid)

Cognizant Technology Solutions Corporation
West Des Moines, IA, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$90,000.0 - $150,000.0
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Business Analytics Applications Automation of Tests Microsoft Azure Cloud Database Software Quality Code Review Continuous Integration Data Governance Data Infrastructure Data Masking Data Security
+16 more
Distributed Systems Meta-Data Management Query Optimization Role-Based Access Control SQL Databases Unstructured Data Data Logging Data Ingestion Delivery Pipeline Parallel Computation Pyspark Data Management Software Version Control Data Pipelines Legacy Systems Databricks

Job description

This hybrid role is for a Senior Architect with deep hands-on expertise in Databricks SQL, Databricks Workflows, and PySpark. The candidate will drive end-to-end data platform and analytics solutions for a global organization, designing, optimizing, and governing scalable cloud-based data architectures that enable trusted insights, improve business decisions, and support responsible innovation., + Design and implement scalable cloud-based data architectures on Databricks to support complex analytical workloads and reliable data products.

  • Develop robust data pipelines using Databricks Workflows and PySpark to ingest, transform, and curate large volumes of structured and unstructured data.

  • Optimize Databricks SQL queries and data models for high-performance, low-latency analytics.

  • Establish reusable frameworks and patterns for data ingestion, transformation, and orchestration to improve consistency and reduce time-to-market.

  • Collaborate with product owners, data engineers, and analysts to translate business requirements into scalable technical solutions aligned with enterprise architecture standards.

  • Define and enforce best practices for code quality, version control, testing, and deployment in Databricks environments.

  • Implement monitoring, logging, and alerting mechanisms to enhance reliability and observability of workflows and jobs.

  • Design secure data access models (RBAC, data masking, encryption) to ensure compliance with regulatory and security standards.

  • Drive modernization by migrating legacy systems into Databricks-based platforms, simplifying architecture and reducing operational complexity.

  • Conduct architecture and code reviews to ensure performance, scalability, and maintainability.

  • Partner with cloud and infrastructure teams to optimize compute, storage, and networking for cost efficiency and performance.

Requirements

  • Extensive experience in designing and implementing enterprise-scale data platforms using Databricks, Databricks SQL, Databricks Workflows, and PySpark.

  • Strong proficiency in SQL, data modeling, and query optimization for analytical workloads.

  • Hands-on experience in building and orchestrating complex data pipelines within Databricks (scheduling, dependency management, recovery strategies).

  • Solid understanding of distributed computing concepts (cluster configuration, parallel processing, resource tuning).

  • Experience with data governance, data quality, and metadata management frameworks.

  • Hands-on expertise with CI/CD practices for Databricks deployments, including automated testing and release pipelines.

  • Strong communication and collaboration skills to work effectively with cross-functional stakeholders.

  • Proven experience in large-scale cloud-based data ecosystems and modern data platform

Preferred Certifications

  • Databricks Certified Data Engineer Professional

  • Databricks Certified Data Engineer Associate

  • Equivalent cloud data certification (Azure, AWS, or GCP)

Benefits & conditions

The annual salary for this position is between $ 90,000 - $ 150,000 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

  • Medical/Dental/Vision/Life Insurance

  • Paid holidays plus Paid Time Off

  • 401(k) plan and contributions

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:39 min

Addressing code review surrender and process exploitation

Laura Tacho Laura Tacho · World Congress 2026 Europe

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:38 min

Architecting a unified data and machine learning workbench

Kapil Gupta Kapil Gupta · World Congress 2025

Videos

See all

Related articles

See all