Lead Data Engineer / Delivery Lead

LA Inc
Baltimore, United States of America
14 days ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 187K

Job location

Remote
Baltimore, United States of America

Tech stack

JavaScript
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Data analysis
Cloud Computing
Cloud Engineering
Information Engineering
ETL
Data Warehousing
Dimensional Modeling
Python
Ruby on Rails
SQL Databases
Software Security
PySpark
Data Pipelines
Databricks

Job description

Lead end-to-end data engineering delivery while serving as the primary client-facing program owner, ensuring scalable data solutions and successful project execution.

Day-to-Day Responsibilities:

  • Lead development and optimization of data pipelines using Databricks, SQL, Python, and PySpark
  • Design and maintain data models, Lakehouse architecture, and data marts
  • Orchestrate and monitor ETL/ELT workflows, ensuring performance and reliability
  • Act as primary point of contact for stakeholders, running meetings and providing updates
  • Manage timelines, deliverables, and overall workstream execution
  • Coordinate across onshore/offshore teams and unblock technical challenges
  • Conduct code reviews, enforce best practices, and mentor engineering team members
  • Oversee data quality, monitoring, alerting, and production issue resolution
  • Translate business requirements into scalable technical solutions

Requirements

Must be authorized to work in the U.S. This position is not eligible for sponsorship., * Must-Haves:

  • 8-12 years of experience in data engineering or analytics roles
  • Strong hands-on experience with Databricks (critical requirement)
  • Proficiency in SQL, Python, and PySpark
  • Experience building and maintaining scalable ETL/ELT pipelines
  • Strong understanding of data warehousing and dimensional modeling
  • Experience with workflow orchestration tools (e.g., Airflow)
  • Cloud experience (AWS preferred; any cloud acceptable with Databricks)
  • Proven experience in client/stakeholder management and communication
  • Experience owning projects, managing timelines, and delivering end-to-end solutions
  • Leadership experience guiding teams and coordinating across multiple workstreams
  • Nice-to-Haves:
  • Media or entertainment industry experience
  • Experience leading offshore teams
  • Prior experience in a tech lead, delivery lead, or solutions role
  • AWS-specific expertise
  • Master's degree in a relevant field

Apply for this position