Lead Data Engineer in Los Angeles
Energy Jobline
Los Angeles, United States of America
28 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 150KJob location
Los Angeles, United States of America
Tech stack
Airflow
Amazon Web Services (AWS)
Cloud Computing
Code Review
Data Architecture
Information Engineering
ETL
Data Mart
Data Warehousing
Dimensional Modeling
Python
SQL Databases
PySpark
Data Pipelines
Databricks
Job description
Lead end-to-end data engineering delivery while serving as the primary client-facing program owner, ensuring scalable data solutions and successful project execution.
Day-to-Day Responsibilities:
- Lead development and optimization of data pipelines using Databricks, SQL, Python, and PySpark
- Design and maintain data models, Lakehouse architecture, and data marts
- Orchestrate and monitor ETL/ELT workflows, ensuring performance and reliability
- Act as primary point of contact for stakeholders, running meetings and providing updates
- Manage timelines, deliverables, and overall workstream execution
- Coordinate across onshore/offshore teams and unblock technical challenges
- Conduct code reviews, enforce best practices, and mentor engineering team members
- Oversee data quality, monitoring, alerting, and production issue resolution
- Translate business requirements into scalable technical solutions
Requirements
Must be authorized to work in the U.S. This position is not eligible for sponsorship., * Must-Haves:
- 8-12 years of experience in data engineering or analytics roles
- Strong hands-on experience with Databricks (critical requirement)
- Proficiency in SQL, Python, and PySpark
- Experience building and maintaining scalable ETL/ELT pipelines
- Strong understanding of data warehousing and dimensional modeling
- Experience with workflow orchestration tools (e.g., Airflow)
- Cloud experience (AWS ; any cloud acceptable with Databricks)
- Proven experience in client/stakeholder management and communication
- Experience owning projects, managing timelines, and delivering end-to-end solutions
- Leadership experience guiding teams and coordinating across multiple workstreams
- Nice-to-Haves:
- Media or entertainment industry experience
- Experience leading offshore teams
- Prior experience in a tech lead, delivery lead, or solutions role
- AWS-specific expertise
- Master's degree in a relevant field