Lead Data Engineer / Delivery Lead
LA Inc
Baltimore, United States of America
14 days ago
Role details
Contract type
Temporary to permanent Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 187KJob location
Remote
Baltimore, United States of America
Tech stack
JavaScript
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Data analysis
Cloud Computing
Cloud Engineering
Information Engineering
ETL
Data Warehousing
Dimensional Modeling
Python
Ruby on Rails
SQL Databases
Software Security
PySpark
Data Pipelines
Databricks
Job description
Lead end-to-end data engineering delivery while serving as the primary client-facing program owner, ensuring scalable data solutions and successful project execution.
Day-to-Day Responsibilities:
- Lead development and optimization of data pipelines using Databricks, SQL, Python, and PySpark
- Design and maintain data models, Lakehouse architecture, and data marts
- Orchestrate and monitor ETL/ELT workflows, ensuring performance and reliability
- Act as primary point of contact for stakeholders, running meetings and providing updates
- Manage timelines, deliverables, and overall workstream execution
- Coordinate across onshore/offshore teams and unblock technical challenges
- Conduct code reviews, enforce best practices, and mentor engineering team members
- Oversee data quality, monitoring, alerting, and production issue resolution
- Translate business requirements into scalable technical solutions
Requirements
Must be authorized to work in the U.S. This position is not eligible for sponsorship., * Must-Haves:
- 8-12 years of experience in data engineering or analytics roles
- Strong hands-on experience with Databricks (critical requirement)
- Proficiency in SQL, Python, and PySpark
- Experience building and maintaining scalable ETL/ELT pipelines
- Strong understanding of data warehousing and dimensional modeling
- Experience with workflow orchestration tools (e.g., Airflow)
- Cloud experience (AWS preferred; any cloud acceptable with Databricks)
- Proven experience in client/stakeholder management and communication
- Experience owning projects, managing timelines, and delivering end-to-end solutions
- Leadership experience guiding teams and coordinating across multiple workstreams
- Nice-to-Haves:
- Media or entertainment industry experience
- Experience leading offshore teams
- Prior experience in a tech lead, delivery lead, or solutions role
- AWS-specific expertise
- Master's degree in a relevant field