ML Data Platform Engineer

Saas Talent
United States
1 day ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$165,000 - $175,000
Working hours
Regular working hours
Job source

Tech stack

Training Data Geographic Information Systems Application Programming Interfaces (APIs) Airflow Apache HTTP Server Software as a Service Continuous Integration Data Architecture Information Engineering Data Infrastructure Information Leak Prevention Data Transformation
+38 more
Amazon DynamoDB Fraud Prevention and Detection Python (Programming Language) PostgreSQL Machine Learning Octopus Deploy Operational Databases Software Maintenance Redis Prometheus Software Engineering SQL Databases Data Streaming Systems Integration Management of Software Versions Workflow Management Systems Feature Store Data Ingestion Snowflake Grafana Apache Spark Data Lakes Kubernetes Real-time Inference Information Technology Low Latency Apache Flink Cassandra Real Time Data Apache Kafka Machine Learning Operations Presto Video Streaming Terraform Stream Processing Data Pipelines KServe Databricks

Job description

  • Own and extend production batch and streaming pipelines that supply data and features for machine learning model training and online inference.
  • Build event-time streaming systems that handle late-arriving and out-of-order events, while ensuring point-in-time correctness and preventing data leakage and training-serving skew.
  • Develop and maintain production software in Python and SQL, including data transformations, integrations, and services supporting the ML data platform.
  • Build reliable processes for data quality monitoring, freshness, schema evolution, feature versioning, backfills, replays, and recovery when upstream data feeds fail.
  • Design and operate systems that deliver near-real-time features to ML models at low latency, while managing pipeline performance, reliability, and operating costs.
  • Collaborate with ML engineers and software teams on data architecture, feature development, model deployment, serving, and monitoring.

Requirements

You must have hands-on experience building production data or feature pipelines for machine learning systems, including streaming data processing and handling events that arrive late or out of order., * 5+ years of professional experience in data engineering, software engineering, or MLOps.

  • 2+ years personally building and operating production data or feature pipelines supporting machine learning systems.
  • Hands-on experience with event-time stream processing, including handling late-arriving data and maintaining correctness across multiple data sources.
  • Experience identifying and resolving data leakage, training-serving skew, and inconsistencies between historical training data and online inference data.
  • Strong production Python and SQL engineering experience, including writing, testing, reviewing, deploying, and maintaining software and data pipelines.
  • Experience integrating multiple external data sources with different latency and reliability characteristics, and operating scalable data pipelines while managing performance and costs.

Preferred Experience

  • Apache Kafka, Apache Spark, Apache Flink, or equivalent streaming technologies such as Amazon Kinesis.
  • Apache Iceberg, Trino, Delta Lake, Apache Hudi, Presto, Snowflake, or Databricks.
  • Feature stores such as Feast, Chronon, or internally developed feature platforms.
  • Low-latency feature serving using PostgreSQL, Redis, Cassandra, DynamoDB, or similar technologies.
  • Building internal APIs or tools that allow ML engineers to define, access, and manage features.
  • Workflow orchestration using Airflow, Dagster, or Argo Workflows.
  • Kubernetes and production observability tools such as Grafana and Prometheus.
  • Infrastructure as code, CI/CD, and GitOps using Terraform, Helm, Argo CD, Flux, or similar technologies.
  • MLflow, KServe, or related model deployment and serving technologies.
  • Experience with geospatial data, time-series data, or large real-time data flows.
  • Experience in fintech, fraud detection, ad tech, marketplaces, logistics, trading, IoT, telematics, telecommunications, or real-time sports and gaming systems.
  • Bachelor’s degree in Computer Science or a related field.

About the company

SaaS Talent is more than just a recruiting company. We’re your hiring, business development and growth partner with 20+ years of experience in SaaS and Hi-Tech that helps you scale and transform your business. We’ve worked with 100+ companies and helped them achieve their goals. From streamlining sales, marketing, and operations to hiring ideal talent and getting funding, if you’re struggling to grow, we’re an ideal choice.

Reach out to us at www.saas-talent.com to learn more about how we can help you.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Loading talks and stories from around this role…