Lead Data Engineer / Delivery Lead

LA Inc
Baltimore, MD, United States
3 months ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$166,400.0 - $187,200.0
Working hours
Regular working hours
Job source

Tech stack

JavaScript (Programming Language) Artificial Intelligence Airflow Amazon Web Services Data Analysis Cloud Computing Cloud Engineering Information Engineering Extract Transform Load (ETL) Data Warehousing Dimensional Modeling Python (Programming Language)
+6 more
Ruby on Rails SQL Databases Software Security Pyspark Data Pipelines Databricks

Job description

Lead end-to-end data engineering delivery while serving as the primary client-facing program owner, ensuring scalable data solutions and successful project execution.

Day-to-Day Responsibilities:

  • Lead development and optimization of data pipelines using Databricks, SQL, Python, and PySpark
  • Design and maintain data models, Lakehouse architecture, and data marts
  • Orchestrate and monitor ETL/ELT workflows, ensuring performance and reliability
  • Act as primary point of contact for stakeholders, running meetings and providing updates
  • Manage timelines, deliverables, and overall workstream execution
  • Coordinate across onshore/offshore teams and unblock technical challenges
  • Conduct code reviews, enforce best practices, and mentor engineering team members
  • Oversee data quality, monitoring, alerting, and production issue resolution
  • Translate business requirements into scalable technical solutions

Requirements

Must be authorized to work in the U.S. This position is not eligible for sponsorship., * Must-Haves:

  • 8-12 years of experience in data engineering or analytics roles
  • Strong hands-on experience with Databricks (critical requirement)
  • Proficiency in SQL, Python, and PySpark
  • Experience building and maintaining scalable ETL/ELT pipelines
  • Strong understanding of data warehousing and dimensional modeling
  • Experience with workflow orchestration tools (e.g., Airflow)
  • Cloud experience (AWS preferred; any cloud acceptable with Databricks)
  • Proven experience in client/stakeholder management and communication
  • Experience owning projects, managing timelines, and delivering end-to-end solutions
  • Leadership experience guiding teams and coordinating across multiple workstreams
  • Nice-to-Haves:
  • Media or entertainment industry experience
  • Experience leading offshore teams
  • Prior experience in a tech lead, delivery lead, or solutions role
  • AWS-specific expertise
  • Master’s degree in a relevant field

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on gosnaphop.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all