Senior Databricks Engineer

SOGETI
Milltown, United States of America
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 115K

Job location

Milltown, United States of America

Tech stack

Amazon Web Services (AWS)
Data analysis
Azure
Cloud Computing
Information Engineering
Data Governance
Data Warehousing
Hive
Performance Tuning
DataOps
Data Processing
Snowflake
Spark
Data Lake
PySpark
Optimization Algorithms
Data Management
Data Pipelines
Databricks

Job description

  • Lead the design and implementation of scalable, high?performance data platforms using Databricks and Apache Spark.
  • Optimize lakehouse solutions leveraging Delta Lake features such as ACID transactions, time travel, and performance optimization.
  • Design advanced data models (star, snowflake, normalized) to support analytics and data warehousing workloads.
  • Build and manage end?to?end data pipelines using Spark SQL and PySpark for high?volume data processing.
  • Implement and manage Unity Catalog to ensure robust data governance, security, and access control.
  • Develop, schedule, and monitor Databricks Jobs, Workflows, and Clusters to ensure reliable and efficient data operations.

Requirements

  • Must have at least 5 years of experience in data engineering and experience as a team lead
  • Strong hands-on experience with Databricks in production environments.
  • Deep expertise in Apache Spark, including Spark SQL and PySpark.
  • Proven experience working with Delta Lake, including ACID compliance, time travel, and optimization techniques.
  • Hands-on experience with Unity Catalog for data governance and security.
  • Strong knowledge of data modeling techniques and data warehousing/analytics patterns.
  • Cloud platform experience with Azure, AWS, or GCP.

Benefits & conditions

Life at Sogeti: Sogeti supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

  • Flexible work options
  • 401(k) with 150% match up to 6%
  • Employee Share Ownership Plan
  • Medical, Prescription, Dental & Vision Insurance
  • Life Insurance
  • 100% Company-Paid Mobile Phone Plan
  • 3 Weeks PTO + 7 Paid Holidays
  • Paid Parental Leave
  • Adoption, Surrogacy & Cryopreservation Assistance
  • Subsidized Back-up Child/Elder Care & Tutoring
  • Career Planning & Coaching
  • $5,250 Tuition Reimbursement & 20,000+ Online Courses
  • Employee Resource Groups
  • Counseling & Support for Physical, Financial, Emotional & Spiritual Well-being
  • Disaster Relief Programs

About Sogeti

Part of the Capgemini Group, Sogeti makes business value through technology for organizations that need to implement innovation at speed and want a local partner with global scale. With a hands-on culture and close proximity to its clients, Sogeti implements solutions that will help organizations work faster, better, and smarter. By combining its agility and speed of implementation through a DevOps approach, Sogeti delivers innovative solutions in quality engineering, cloud and application development, all driven by AI, data and automation.

Become Your Best | www.sogeti.us

Disclaimer, Capgemini discloses salary range information in compliance with state and local pay transparency obligations. The disclosed range represents the lowest to highest salary we, in good faith, believe we would pay for this role at the time of this posting, although we may ultimately pay more or less than the disclosed range, and the range may be modified in the future. The disclosed range takes into account the wide range of factors that are considered in making compensation decisions including, but not limited to, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, performance, sales or revenue-based metrics, and business or organizational needs. At Capgemini, it is not typical for an individual to be hired at or near the top of the range for their role. The base salary range for the tagged location is 90k-115k.

This role may be eligible for other compensation including variable compensation, bonus, or commission. Full time regular employees are eligible for paid time off, medical/dental/vision insurance, 401(k), and any other benefits to eligible employees.

Note: No amount of pay is considered to be wages or compensation until such amount is earned, vested, and determinable. The amount and availability of any bonus, commission, or any other form of compensation that are allocable to a particular employee remains in the Company's sole discretion unless and until paid and may be modified at the Company's sole discretion, consistent with the law.

Apply for this position