ML Data Platform Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+38 more
Job description
- Own and extend production batch and streaming pipelines that supply data and features for machine learning model training and online inference.
- Build event-time streaming systems that handle late-arriving and out-of-order events, while ensuring point-in-time correctness and preventing data leakage and training-serving skew.
- Develop and maintain production software in Python and SQL, including data transformations, integrations, and services supporting the ML data platform.
- Build reliable processes for data quality monitoring, freshness, schema evolution, feature versioning, backfills, replays, and recovery when upstream data feeds fail.
- Design and operate systems that deliver near-real-time features to ML models at low latency, while managing pipeline performance, reliability, and operating costs.
- Collaborate with ML engineers and software teams on data architecture, feature development, model deployment, serving, and monitoring.
Requirements
You must have hands-on experience building production data or feature pipelines for machine learning systems, including streaming data processing and handling events that arrive late or out of order., * 5+ years of professional experience in data engineering, software engineering, or MLOps.
- 2+ years personally building and operating production data or feature pipelines supporting machine learning systems.
- Hands-on experience with event-time stream processing, including handling late-arriving data and maintaining correctness across multiple data sources.
- Experience identifying and resolving data leakage, training-serving skew, and inconsistencies between historical training data and online inference data.
- Strong production Python and SQL engineering experience, including writing, testing, reviewing, deploying, and maintaining software and data pipelines.
- Experience integrating multiple external data sources with different latency and reliability characteristics, and operating scalable data pipelines while managing performance and costs.
Preferred Experience
- Apache Kafka, Apache Spark, Apache Flink, or equivalent streaming technologies such as Amazon Kinesis.
- Apache Iceberg, Trino, Delta Lake, Apache Hudi, Presto, Snowflake, or Databricks.
- Feature stores such as Feast, Chronon, or internally developed feature platforms.
- Low-latency feature serving using PostgreSQL, Redis, Cassandra, DynamoDB, or similar technologies.
- Building internal APIs or tools that allow ML engineers to define, access, and manage features.
- Workflow orchestration using Airflow, Dagster, or Argo Workflows.
- Kubernetes and production observability tools such as Grafana and Prometheus.
- Infrastructure as code, CI/CD, and GitOps using Terraform, Helm, Argo CD, Flux, or similar technologies.
- MLflow, KServe, or related model deployment and serving technologies.
- Experience with geospatial data, time-series data, or large real-time data flows.
- Experience in fintech, fraud detection, ad tech, marketplaces, logistics, trading, IoT, telematics, telecommunications, or real-time sports and gaming systems.
- Bachelorβs degree in Computer Science or a related field.
About the company
SaaS Talent is more than just a recruiting company. Weβre your hiring, business development and growth partner with 20+ years of experience in SaaS and Hi-Tech that helps you scale and transform your business. Weβve worked with 100+ companies and helped them achieve their goals. From streamlining sales, marketing, and operations to hiring ideal talent and getting funding, if youβre struggling to grow, weβre an ideal choice.
Reach out to us at www.saas-talent.com to learn more about how we can help you.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦