Senior Databricks Engineer

PHOTON, LLC
Irving, TX, United States
3 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Airflow Cloud Computing Data Infrastructure Extract Transform Load (ETL) Data Warehousing Python (Programming Language) Standard Sql Data Ingestion Azure Data Factory Apache Spark Git Data Lakes
+5 more
Pyspark AWS Glue Apache Kafka Data Pipelines Databricks

Job description

Job Summary: Seeking Senior Databricks Engineers to develop and support modern data platforms using Databricks, Spark, and cloud technologies. The role will focus on building high-performance data pipelines and supporting analytics initiatives., * Develop ETL/ELT pipelines using Databricks and PySpark.

  • Build and maintain Delta Lake data pipelines.
  • Develop notebooks, workflows, and automated jobs.
  • Perform data ingestion from multiple source systems.
  • Optimize Spark jobs and improve performance.
  • Support testing, deployment, and production validation.
  • Collaborate with business and analytics teams.
  • Monitor and troubleshoot production issues.

Requirements

  • Databricks
  • PySpark
  • Python
  • SQL
  • Delta Lake
  • Data Warehousing
  • ETL/ELT Development
  • Azure Data Factory or AWS Glue
  • Git

Preferred Skills

  • Delta Live Tables
  • Unity Catalog
  • Kafka
  • Airflow
  • Banking & Financial Services domain

About the company

We are Photon, one of the world’s largest Digital Platform Engineering companies providing a unique combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We are a high growth organization serving over 40% of Fortune 100 companies and truly believe that our people make the world of difference for our clients and our business. With Photon, you get the opportunity to learn and grow, build deep digital/technical expertise, and achieve your professional and personal aspirations. Check out our introduction video - We are actively hiring and found your profile very interesting! We’d love the opportunity to connect with you and explore possibilities to build an exciting future together!

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…