Staff Software Engineer, Data Platform

Agility Logistics Corp.
Pittsburgh, PA, United States
1 day ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$191,000.0 - $299,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Amazon Web Services Amazon S3 Microsoft Azure Big Data C++ (Programming Language) Cloud Computing Data Infrastructure Distributed Systems Protocol Buffers Monitoring of Systems Java Virtual Machine (JVM)
+16 more
Python (Programming Language) Prometheus Parquet Cloud Platform System Data Ingestion Grafana Apache Spark Kubernetes Apache Flink Avro Apache Kafka Build Tools Multiaccess Edge Computing Data Pipelines Databricks Microservices

Job description

Join the cutting-edge team building the data platform that powers fleet-scale humanoid robotics. As a Staff Software Engineer on our Data Platform team, you will play a pivotal role in designing, developing, and maintaining the infrastructure that enables efficient ingestion, processing, discovery, serving, and analysis of massive datasets generated by our robots. Your work will directly contribute to improving robot performance, operational insights, and scaling our cloud-based systems., * Data Ingestion: Design and implement scalable data pipelines for ingesting and processing telemetry, logs and sensor data from our fleet of robots and associated cloud software

  • Data Agents: Develop and maintain data ingestion agents running directly on robot software to ingest high volume data in low connectivity environments.
  • Data Formats: Maintain and develop data formats and protocols optimized for transmission, storage and query of data recordings, sensor data and telemetry.
  • Observability systems: Develop and maintain observability systems using tools like fluentbit, OpenTelemetry etc enabling real-time monitoring and analytics of fleet operations.
  • Big Data Processing: Implement solutions to prepare high volume, high velocity data for analysis using technologies such as Spark, Kafka or equivalent
  • Cloud Platform: Build and optimize tools for internal stakeholders for business intelligence and long-horizon fleet analytics and forecasting using existing tools like AWS S3, Athena, Sagemaker etc.
  • IoT integration: Leverage IoT experience to improve data collection and processing pipelines from robot sensors and edge devices.

Requirements

  • 5+ years of strong experience in building and scaling cloud-based data platforms with familiarity in cloud providers like AWS, GCP or Azure.
  • Proficient in big data frameworks like Spark, Kafka, Beam, Flink etc
  • Familiarity with OSS data formats like Parquet, Arrow, Iceberg and protocols like Avro and Protobuf.
  • Experience with observability tools(e.g. OpenTelemetry, Prometheus etc) and implementing metrics, tracing and logging systems
  • Proficiency in languages like Java, Scala (any JVM), or Python and a solid understanding of distributed systems and microservices architectures.

Bonus Qualifications

  • Experience with Robotics, Autonomous Vehicles, or other sensor heavy workloads will be strongly preferred.
  • Knowledge of IoT systems, edge computing or working with embedded devices is nice-to-have.
  • Data catalog experience (Datahub, Amundsen, Databricks Unity Catalog)
  • Experience with Databricks
  • Experience with Kubernetes
  • Experience with Bazel/Blaze or other build systems
  • Experience with C++, Rust
  • Experience with robot data formats like mcap, ROS etc and data playback and visualization tooling like Rerun etc.

Benefits & conditions

This is a fully remote role with the option to work hybrid if a commutable distance from our Salem, OR, Pittsburgh, PA, or Fremont, CA offices.

The final salary offered to a successful candidate will be dependent on several factors that may include but are not limited to: market location, job-related knowledge, skills, and experience. This range may change based on geographical location and may be modified in the future. Anticipated Base Salary Range $191,000-$299,000 USD

In addition to base pay, our competitive total rewards package consists of the following for full-time employees:

  • 401(k) Plan: Includes a 6% company match.
  • Equity: Company stock options.
  • Insurance Coverage: 100% company-paid medical, dental, vision, and short/long-term disability insurance for employees.
  • Benefit Start Date: Eligible for benefits on your first day of employment.
  • Well-Being Support: Employee Assistance Program (EAP).
  • Time Off:
  • Exempt Employees: Flexible, unlimited PTO and 12 company holidays, including a winter shutdown.
  • Non-Exempt Employees: 10 vacation days, paid sick leave, and 12 company holidays, including a winter shutdown, annually.
  • On-Site Perks: Catered lunches four times a week and a variety of healthy snacks and refreshments at our Salem and Pittsburgh locations.
  • Parental Leave: Generous paid parental leave programs.
  • Work Environment: A culture that supports flexible work arrangements.
  • Growth Opportunities: Professional development and tuition reimbursement programs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:02 min

Audience Q&A on data formats and engine tradeoffs

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou · Coffee With Developers

2:50 min

How Parquet metadata enables efficient data reading

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

1:52 min

Customizing block storage tiers and formats

Ricardo Sueiras Sueiras · LIVE

2:03 min

Introduction to open table formats built on Parquet

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

Videos

See all

Related articles

See all