Lead Data Engineer

Honeywell International Inc.
Atlanta, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Shift work
Languages
English
Experience level
Senior

Job location

Atlanta, United States of America

Tech stack

Agile Methodologies
Artificial Intelligence
Amazon Web Services (AWS)
Azure
Cloud Database
Code Review
Databases
Continuous Integration
Data Architecture
Information Engineering
Data Governance
Data Infrastructure
Data Security
Data Vault Modeling
DevOps
Dimensional Modeling
Fault Tolerance
Github
Machine Learning
Octopus Deploy
Product Management
Systems Development Life Cycle
Data Streaming
Software Technical Review
Unstructured Data
Data Ingestion
Large Language Models
Spark
Containerization
Data Lake
PySpark
Kubernetes
Kafka
Machine Learning Operations
Stream Processing
Software Version Control
Data Pipelines
Serverless Computing
Bamboo
Docker
Databricks

Job description

You will report directly to our Sr. Data Engineering Manager and you'll work out of our Atlanta, GA location on a Hybrid work schedule.

Hybrid Work Schedule Note: For the first 90 days, New Hires must be prepared to work 100% onsite M-F, Architecture & Technical Leadership

  • Architect end-to-end data pipelines processing terabytes of IoT telemetry on Azure Databricks (PySpark DLT, Lakeflow) using medallion Lakehouse architecture.
  • Design and optimize real-time ingestion pipelines from Azure Event Hub and Apache Kafka for high-volume industrial IoT telemetry.
  • Build fault-tolerant, idempotent streaming architectures handling schema evolution, backpressure, and latency SLAs.
  • Lead architecture reviews, set engineering standards, and drive decisions on data modeling, pipeline design, and platform evolution.
  • Define technical direction for AI-ready data products including vector stores, embedding pipelines, and RAG-ready structured/unstructured data.
  • Adopt emerging LLM orchestration frameworks (LangChain, LangGraph) to accelerate GenAI platform capabilities.

GenAI & AI Pipeline Development

  • Build production GenAI pipelines- RAG workflows, document ingestion, PII anonymization and vector database infrastructure.
  • Collaborate with data scientists and AI engineers to deliver high-quality, AI-ready datasets that improve downstream model performance.

DevOps, Security & Governance

  • Enforce data governance, access control, and security policies; lead PII detection and anonymization strategies across the data platform.
  • Champion CI/CD practices using GitHub Actions, DAB, Octopus, and Bamboo for automated, reliable pipeline delivery.
  • Ensure compliance with enterprise security standards within the SDLC.

Team Development & Stakeholder Engagement

  • Mentor engineers across seniority levels through code reviews, pairing, and technical coaching.
  • Translate business and AI product requirements into clear technical roadmaps and execution plans.
  • Partner with data scientists, product owners, and architects to align data investments with Honeywell's autonomy strategy.

Requirements

  • 8+ years of data engineering experience with at least 2 years in a lead or senior role, demonstrating progression in technical complexity and team leadership.
  • Hands-on experience building and operating medallion lakehouse architectures (Bronze / Silver / Gold).
  • Deep expertise in Apache Spark / PySpark with production experience on Azure Databricks at scale.
  • Strong proficiency with streaming platforms - Apache Kafka and/or Azure Event Hub for real-time IoT data.
  • Cloud data architecture skills (Azure preferred; AWS/GCP a plus) with experience designing scalable, cost-effective data lakes and warehouses using cloud-native services.
  • Data modeling and schema design expertise for both transactional and analytical workloads, including dimensional modeling and data vault methodologies.
  • Proven experience building data pipelines for GenAI or ML applications: RAG systems, embedding pipelines, and document ingestion.
  • MLOps familiarity including model versioning, feature stores, and monitoring/observability for data and ML systems.
  • Demonstrated ability to lead technical design reviews, mentor engineers, and drive architectural decisions with stakeholder buy-in.
  • Proficiency in CI/CD using GitHub Actions for automating data pipeline deployments.

WE VALUE

  • Experience with LangChain, LangGraph, or other agentic AI orchestration frameworks.
  • Expertise in real-time data processing frameworks (Apache Spark Streaming, Structured Streaming)
  • Knowledge of MLOps practices and experience building data pipelines for AI model deployment
  • Experience with time-series databases and IoT data modeling patterns
  • Familiarity with containerization (Docker) and orchestration (Kubernetes) for AI workloads
  • Strong background in data quality implementation for AI training data
  • Experience working with distributed teams and cross-functional collaboration
  • Knowledge of data security and governance practices for AI systems
  • Experience working on analytics projects with Agile and Scrum Methodologies

US PERSON REQUIREMENTS :

Due to compliance with U.S. export control laws and regulations, candidate must be a U.S. Person which is defined as a U.S. citizen, a U.S. permanent resident, or have protected status In the U.S. under asylum or refugee status or have the ability to obtain an export authorization.

Benefits & conditions

In addition to a competitive salary, leading-edge work, and developing solutions side-by-side with dedicated experts in their fields, Honeywell employees are eligible for a comprehensive benefits package. This package includes employer subsidized Medical, Dental, Vision, and Life Insurance; Short-Term and Long-Term Disability; 401(k) match, Flexible Spending Accounts, Health Savings Accounts, EAP, and Educational Assistance; Parental Leave, Paid Time Off (for vacation, personal business, sick time, and parental leave), and 12 Paid Holidays. Learn more (https://benefits.honeywell.com/)

About the company

Honeywell is accelerating its transformation from industrial automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data Platforms team, you will architect and own the data foundations that enable physical AI at scale: from terabytes of IoT sensor telemetry streaming through our medallion lakehouse to production-grade Generative AI pipelines that deliver actionable intelligence across Honeywell's global industrial operations. You will serve as a technical anchor for a team of engineers, shaping architecture decisions, building cutting edge AI solutions, raising engineering standards, and directly building the AI-ready data products that Honeywell's autonomy mission depends on. This role sits at the intersection of modern data engineering and applied GenAI, if you are energized by building systems that have real-world industrial impact, this is your role., Honeywell International Inc. (Nasdaq: HON) invents and commercializes technologies that address some of the world's most critical challenges around energy, safety, security, productivity, and global urbanization. We are a leading software-industrial company committed to introducing state of the art technology solutions to improve efficiency, productivity, sustainability, and safety in high growth businesses in broad-based, attractive industrial end markets. Our products and solutions enable a safer, more comfortable, and more productive world, enhancing the quality of life of people around the globe. Learn more (https://www.honeywell.com/us/en), Corporate (CORP) at Honeywell provides centralized services and strategic leadership that supports all business units globally. This unit focuses on driving innovation, operational excellence, and enabling technology solutions that empower Honeywell's diverse portfolio of businesses to achieve sustainable growth and competitive advantage. Honeywell helps organizations solve the world's most complex challenges in automation, the future of aviation and energy transition. As a trusted partner, we provide actionable solutions and innovation through our Aerospace Technologies, Building Automation, Energy and Sustainability Solutions, and Industrial Automation business segments - powered by our Honeywell Forge software - that help make the world smarter, safer and more sustainable. Honeywell is an equal opportunity employer. Qualified applicants will be considered without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, sex, religion, or veteran status.

Apply for this position