Data Platform Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+6 more
Job description
Experteer Overview In this role, you will build the data backbone for Hadrian’s autonomous factories, turning machine signals and operational data into trusted datasets for scheduling, ML, and analytics. You’ll own data ingestion, streaming, contracts, quality, and lineage to enable reliable, scalable analysis and AI-driven decision-making. You’ll work with cross-functional teams to integrate diverse data sources from factory floor systems. This is a data-platform and distributed-systems role with high impact on manufacturing outcomes. Compensation / Benefits * Build the data backbone for factory data used by scheduling, ML, and operations * Develop ingestion, CDC, and streaming for transactional data, events, telemetry, and files with strong focus on ordering, retries, idempotence, and backpressure * Define versioned data and event contracts with upstream teams and ensure data freshness and correctness * Model telemetry, quality events, work orders, and operational data with clear grain, identity, time, provenance, and history * Own Dagster orchestration, dbt transformation, data CI/CD, backfills, lineage, observability, and offline feature datasets for ML * Collaborate with Manufacturing Operations and Infrastructure to acquire data from machines, PLCs, historians, OPC-UA, MTConnect, and MQTT sources as needed Tasks * Experience building and operating production data infrastructure or distributed data systems with on-call ownership and recovery * Strong production Python and advanced SQL and data-modeling skills including incremental processing, temporal data, and schema evolution * Experience with Kafka or another event-streaming platform and CDC or stateful incremental pipelines * Experience operating Snowflake and lakehouse formats (Iceberg, Delta, or Hudi) with partitioning and compaction * Experience with Dagster, Airflow, Argo, or Prefect; dbt or similar transformation frameworks; and Kubernetes or infrastructure as code * Strong judgment on contracts, failure modes, and needs of downstream analytics, ML, and operational systems Key requirements * Medical, dental, vision, and life insurance * 401k * Relocation support may be provided * Flexible vacation policy * Equity * On-site employment in Los Angeles
Requirements
and identity, time, provenance, and history * Own Dagster orchestration, dbt transformation, data CI/CD, backfills, lineage, observability, and offline feature datasets for ML * Collaborate with Manufacturing Operations and Infrastructure to acquire data from machines, PLCs, historians, OPC-UA, MTConnect, and MQTT sources as needed Tasks * Experience building and operating production data infrastructure or distributed data systems with on-call ownership and recovery * Strong production Python and advanced SQL and data-modeling skills including incremental processing, temporal data, and schema evolution * Experience with Kafka or another event-streaming platform and CDC or stateful incremental pipelines * Experience operating Snowflake and lakehouse formats (Iceberg, Delta, or Hudi) with partitioning and compaction * Experience with Dagster, Airflow, Argo, or Prefect; dbt or similar transformation frameworks; and Kubernetes or infrastructure as code * Strong judgment on contracts, failure aaa
Benefits & conditions
and and needs of downstream analytics, ML, and operational systems Key requirements * Medical, dental, vision, and life insurance * 401k * Relocation support may be provided * Flexible vacation policy * Equity * On-site employment in Los Angeles
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on us.experteer.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production
Top Big Data Technologies That You Need to Know
Dev Digest 120 - Apple and peers
Dev Digest 132 - Binging WADFlix?