Lead Data Engineer

Robert Half
Stone Park, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Stone Park, United States of America

Tech stack

API
Artificial Intelligence
Amazon Web Services (AWS)
Data analysis
Azure
Data as a Services
Data Architecture
Information Engineering
ETL
Python
Performance Tuning
SQL Databases
Data Ingestion
Large Language Models
Data Lake
Integration Frameworks
Data Management
Data Pipelines

Job description

We are seeking a Lead Data Engineer to own the design, architecture, and delivery of scalable data platforms, AI?powered data products, and enterprise?grade data services. This role goes beyond hands?on engineering and includes technical leadership, architectural decision?making, and strong cross?functional influence across the organization.

You will lead the development of end?to?end data ecosystems-including data ingestion, transformation pipelines, storage layers, APIs, and AI?enabled services-leveraging modern cloud infrastructure and emerging AI/LLM capabilities. You will play a critical role in shaping how data is transformed into actionable insights and production?grade tools that directly support investment decisions and client outcomes., * Own the architecture and technical strategy for scalable, secure, and reliable data platforms

  • Lead the design and development of end?to?end data pipelines (batch and streaming) from ingestion to consumption
  • Build and support cloud?native data platforms, including data lakes, warehouses, and analytics layers
  • Partner with data science and AI teams to productionize AI/ML and LLM?enabled data products
  • Design and maintain APIs and data services used by downstream applications and analytics teams
  • Establish engineering best practices around data quality, observability, governance, and security
  • Serve as a technical leader and mentor, guiding engineers through design decisions and complex problem?solving
  • Collaborate closely with product, analytics, investment, and business stakeholders to translate requirements into scalable technical solutions
  • Evaluate and introduce emerging technologies to continuously improve platform capabilities

Requirements

  • 8+ years of experience in data engineering or platform engineering, with at least 2+ years in a technical lead or architect role
  • Strong experience designing and building cloud?based data platforms (AWS, Azure, or GCP)
  • Deep expertise with SQL and Python, and strong experience with modern data processing frameworks
  • Proven experience designing data lakes, warehouses, and layered data architectures
  • Experience operationalizing AI/ML workloads, including data support for LLMs or advanced analytics
  • Strong knowledge of data modeling, ETL/ELT patterns, and performance optimization
  • Ability to influence architecture and technical direction across multiple teams

Apply for this position