Software Engineer III, Data Platform

Agility Logistics Corp.
Fremont, CA, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$144,000.0 - $224,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Amazon Web Services Amazon S3 Microsoft Azure Big Data C++ (Programming Language) Cloud Computing Data Infrastructure Data Integration Data Visualization Distributed Computing Environment
+22 more
Protocol Buffers Monitoring of Systems Java Virtual Machine (JVM) Python (Programming Language) Machine Learning Prometheus Sensor Fusion System Programming Unstructured Data Parquet Data Processing Cloud Platform System Data Ingestion Grafana Apache Spark Kubernetes Apache Flink Avro Apache Kafka Multiaccess Edge Computing Data Pipelines Microservices

Job description

Join the team building the data backbone for fleet-scale humanoid robotics. As a Software Engineer III on our Data Platform team, you will implement and scale the infrastructure required to ingest, process, and synchronize massive datasets from our robots. You will focus on the technical challenges of handling multimodal log data-ensuring that high-frequency sensor data, video feeds, and telemetry are perfectly aligned for playback and ML training., * Data Ingestion: Design and implement scalable data pipelines for ingesting and processing telemetry, logs and sensor data from our fleet of robots and associated cloud software

  • Multimodal Data Integration: Develop systems to handle complex multimodal logs, ensuring precise synchronization between video, audio, IMU, and joint-state data for downstream analysis and robot “black box” reconstruction/playback.
  • Edge Data Agents: Contribute to the development of data ingestion agents running on-robot to manage high-volume data throughput in variable connectivity environments.
  • Data Optimization: Implement and optimize data formats (e.g., MCAP, Parquet) specifically tuned for the storage and rapid querying of rich multimodal robotics recordings.
  • Observability systems: Develop and maintain observability systems using tools like fluentbit, OpenTelemetry etc enabling real-time monitoring and analytics of fleet operations.
  • Distributed Processing: Use Spark, Kafka, or Flink to transform raw robot data into structured datasets ready for business intelligence and long-horizon fleet analytics.
  • Stakeholder Collaboration: Work closely with AI and Hardware teams to ensure data tools meet the needs of those training the next generation of humanoid models.
  • Cloud Platform: Build and optimize tools for internal stakeholders for business intelligence and long-horizon fleet analytics and forecasting using existing tools like AWS S3, Athena, Sagemaker etc.

Requirements

Do you have experience in Scalable systems?, * 3-5 years of experience building and scaling cloud-based data platforms(AWS, GCP, or Azure).

  • Big Data Tech: Proficient in big data frameworks like Spark, Kafka, Beam, Flink etc
  • Data Formats: Familiarity with OSS data formats like Parquet, Arrow, Iceberg and protocols like Avro and Protobuf.
  • Experience with observability tools(e.g. OpenTelemetry, Prometheus etc) and implementing metrics, tracing and logging systems
  • Strong proficiency in Python and at least one JVM language (Java or Scala), with experience in microservices.
  • Proven experience handling diverse data types-specifically combining unstructured data (logs/video) with structured telemetry, * Robotics/AV Background: Experience with robot-specific data formats (MCAP, ROS bags) and visualization tools like Foxglove or RVIZ.
  • Sensor Fusion: Understanding of time-sync challenges in multimodal data (e.g., PTP/NTP synchronization across sensors).
  • Infrastructure: Experience with Kubernetes and containerized deployment patterns.
  • Systems Programming: Familiarity with C++ or Rust for high-performance data handling at the edge.
  • IoT Knowledge: Experience with edge computing, Greengrass, or managing data from embedded devices.

This is a fully remote role with the option to work hybrid if a commutable distance from our Salem, OR, Pittsburgh, PA, or Fremont, CA offices.

The final salary offered to a successful candidate will be dependent on several factors that may include but are not limited to: market location, job-related knowledge, skills, and experience. This range may change based on geographical location and may be modified in the future.

Benefits & conditions

Pulled from the full job description

  • Tuition reimbursement
  • Paid parental leave
  • Parental leave
  • 401(k)
  • Health insurance
  • Vision insurance
  • Dental insurance, In addition to base pay, our competitive total rewards package consists of the following for full-time employees:
  • 401(k) Plan: Includes a 6% company match.
  • Equity: Company stock options.
  • Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees.
  • Benefit Start Date: Eligible for benefits on your first day of employment.
  • Well-Being Support: Employee Assistance Program (EAP).
  • Time Off:
  • Exempt Employees: Flexible, unlimited PTO and 10 company holidays, including a winter shutdown.
  • Non-Exempt Employees: 10 vacation days, paid sick leave, and 10 company holidays, including a winter shutdown, annually.
  • On-Site Perks: Catered lunches four times a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations.
  • Parental Leave: Generous paid parental leave programs.
  • Work Environment: A culture that supports flexible work arrangements.
  • Growth Opportunities: Professional development and tuition reimbursement programs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:02 min

Audience Q&A on data formats and engine tradeoffs

Matthias Niehoff Matthias Niehoff · WWC Europe 2026

2:50 min

How Parquet metadata enables efficient data reading

Matthias Niehoff Matthias Niehoff · WWC Europe 2026

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

1:52 min

Customizing block storage tiers and formats

Ricardo Sueiras Sueiras · LIVE

2:03 min

Introduction to open table formats built on Parquet

Matthias Niehoff Matthias Niehoff · WWC Europe 2026

Videos

See all

Related articles

See all