Lead Data Platform Engineer

Class Valuation, LLC
Boston, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Boston, United States of America

Tech stack

Java
Artificial Intelligence
Amazon Web Services (AWS)
Computer Vision
Azure
Cloud Computing
Cloud Engineering
Program Optimization
Information Systems
Continuous Integration
Data as a Services
Data Architecture
Information Engineering
Data Infrastructure
Data Systems
Distributed Computing Environment
Distributed Data Store
Distributed Systems
Python
Machine Learning
Operational Data Store
Standard Sql
Software Construction
Software Systems
Data Streaming
Google Cloud Platform
Feature Engineering
Spark
Database Performance
Event Driven Architecture
Build Management
Containerization
Kubernetes
Infrastructure Automation Frameworks
Information Technology
Apache Flink
Kafka
Build Tools
Data Management
Serverless Computing

Job description

A cutting-edge automation company is hiring a Lead Data Platform Engineer to help power the next generation of intelligent warehouse and distribution center technologies. The organization develops advanced robotic solutions that automate storage, retrieval, sorting, and fulfillment operations for some of the largest supply chain and retail networks in the world. Through a combination of robotics, artificial intelligence, computer vision, and large-scale software systems, the company is transforming how products move through modern logistics environments.

As a Lead Data Platform Engineer, you will focus on building the foundational data infrastructure that supports enterprise-scale robotic operations. Unlike a traditional data engineering role centered on reporting and analytics, this position is responsible for developing the platforms that enable operational intelligence, system optimization, fleet orchestration, and AI-driven decision-making across thousands of interconnected robotic assets.

You will work closely with software engineers, controls engineers, robotics specialists, machine learning teams, and product leaders to architect highly available data systems capable of handling enormous volumes of operational data. The ideal candidate is passionate about distributed systems, platform engineering, and building reliable data services that serve both real-time and analytical workloads. This role offers the opportunity to shape technical strategy while remaining deeply involved in hands-on engineering., * Design and build scalable data platforms supporting robotic fleet operations

  • Develop streaming architectures that process millions of operational events daily
  • Create reusable data services that support AI, simulation, and business intelligence workloads
  • Partner with robotics and software teams to define data collection and integration standards
  • Improve performance, reliability, and scalability of mission-critical data systems
  • Build tools that enable real-time visibility into warehouse and automation operations
  • Develop frameworks for operational metrics, system health monitoring, and platform observability
  • Optimize cloud infrastructure supporting data-intensive workloads
  • Support engineering teams by providing reliable access to operational and historical datasets
  • Drive technical improvements across the organization's data ecosystem

Requirements

  • Strong experience building large-scale distributed data platforms
  • Advanced proficiency with Python, Java, or Scala
  • Deep knowledge of data architecture and systems design
  • Experience with Kafka, Spark, Flink, or similar distributed processing technologies
  • Experience with cloud-native architectures in AWS, Azure, or Google Cloud Platform
  • Knowledge of infrastructure automation and containerized environments
  • Experience supporting high-volume streaming data systems
  • Strong SQL and database performance optimization skills
  • Experience with CI/CD and software engineering best practices
  • Understanding of event-driven architectures

Desired Skills & Experience

  • 6+ years of Data Engineering or Platform Engineering experience
  • Experience supporting robotics, manufacturing, industrial automation, or IoT environments
  • Familiarity with machine learning infrastructure and feature engineering platforms
  • Experience with Kubernetes and cloud-native services
  • Knowledge of operational analytics and industrial telemetry systems
  • Experience leading technical projects and mentoring engineers
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field
  • Experience working in fast-growing technology organizations, Applicants must be currently authorized to work in the US on a full-time basis now and in the future.

Benefits & conditions

  • Medical Insurance
  • Dental Benefits
  • Vision Benefits
  • Paid Time Off (PTO)
  • 401(k) (including match, if applicable)

Apply for this position