Sr. Databricks Lead

Capgemini

Cincinnati, OH, United States

3 months ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

$98,467.0 - $153,837.0

Working hours

Regular working hours

Job source

indeed.com

Tech stack

Airflow Microsoft Azure Big Data Information Engineering Fault Tolerance SQL Databases Workflow Management Systems Apache Spark Pyspark Data Pipelines Databricks

Requirements

Do you have experience in Spark?, Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities

Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines

Provide consultation and lead the implementation of data engineering initiatives

MUST HAVE Technology skills:

Strong/expert Spark (PySpark) DataBricks

Hands-on data pipeline development, ingest patterns in Azure

Orchestration tools, ADF or Airflow

SQL

Denormalized Data modeling for big data systems

MUST HAVE competencies:

Collaborative and engaging

Strong analytical and design skills.

Benefits & conditions

Pulled from the full job description

Retirement plan
Vision insurance
Dental insurance, Contract (8 months 5 days) Published 4 months ago Data Pipeline Development pyspark adf databricks azure spark, The pay range that the employer in good faith reasonably expects to pay for this position is $47.34/hour - $73.96/hour. Our offered benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis.