Software Engineer - Data Platform

Scion Staffing, Inc.
San Francisco, CA, United States
about 1 month ago
Apply on scionstaffing.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$240,000.0
Working hours
Regular working hours

Tech stack

Geographic Information Systems Application Programming Interfaces (APIs) Airflow Amazon Web Services Cloud Computing Information Engineering Data Infrastructure Python (Programming Language) Machine Learning NumPy Operational Databases SciPy
+8 more
Software Engineering TypeScript Management of Software Versions Data Storage Technologies Pandas Machine Learning Operations Data Pipelines Programming Languages

Job description

The Senior Data Platform Engineer will serve as an early member of the data engineering team, designing a scalable data platform from the ground up. This individual will transform complex sensor and telemetry data into reliable, well-documented datasets used by machine-learning and perception teams. The position is ideal for an autonomous, collaborative engineer who enjoys solving ambiguous technical challenges and building high-impact systems in a growing environment., * Architect and deploy high-throughput cloud data pipelines that process large volumes of sensor, telemetry, and other complex data.

  • Build post-processing workflows that align, resample, calibrate, and restructure multi-source data for machine-learning applications.
  • Develop scalable backfill and reprocessing frameworks for updated filters, synchronization, labeling corrections, and metadata enrichment.
  • Establish dataset lineage, versioning, documentation, quality monitoring, and reproducibility standards.
  • Create dataset discovery and access APIs or SDKs that support searches by factors such as time, region, modality, labels, and quality indicators.
  • Optimize data storage and build supporting tools, potentially including labeling and pre-labeling workflows, for machine-learning teams.

Requirements

  • At least 5 years of professional data engineering, software engineering, or data platform experience, with startup, early-stage, or greenfield platform-building experience strongly preferred.
  • Demonstrated ability to independently architect and deploy high-throughput data pipelines from the ground up.
  • Strong Python skills and experience with tools such as PyArrow, Polars, Pandas, NumPy, or SciPy.
  • Experience developing production services with Go, Rust, TypeScript, or a comparable programming language.
  • Strong cloud infrastructure experience, preferably with AWS, including deploying and operating production data pipelines.
  • Experience owning datasets as products, including lineage, versioning, reproducibility, documentation, backfills, reprocessing, storage optimization, and data-quality monitoring.
  • Experience with relevant technologies or data domains such as Airflow, Prefect, MLflow, W&B, labeling workflows, edge or multi-source data, time synchronization, or geospatial data.

Benefits & conditions

  • Competitive compensation and a comprehensive benefits package with a long-term equity incentive program
  • Fully remote, full-time position
  • Opportunity to architect and influence a greenfield data platform
  • Highly collaborative environment with significant autonomy and visibility, This full-time opportunity offers competitive base up to $240k/yr (DOE) plus equity (long-term equity incentive program), and 401k and flexible PTO / Holidays / Sick Time.

About the company

Scion Staffing has been engaged to conduct a search for a Senior Data Platform Engineer for an innovative, rapidly growing technology company developing AI-powered systems that transform complex real-world data into actionable insights. This is a full-time, remote position working PST hours. Must be located in the United States., Scion Staffing is a national award-winning staffing firm! Since 2006, we have had the pleasure of successfully placing thousands of talented professionals with amazing career opportunities. Through our innovative team building and recruiting solutions, we bridge the gap in executive leadership searches, direct hire recruiting, interim leadership placement, and temporary professional staffing. We are proud to be part of the Forbes lists of the Best Recruitment Firms and the Best Executive Search Firms in America. Additionally, Scion has been recognized as a ClearlyRated Best of Staffing firm as well as a top recruitment firm by The Business Times. Additional information about our firm can also be found online.

Scion Staffing, Inc. is an equal opportunity employer and service provider and does not discriminate based on race, religion, gender, gender identity, national origin, citizenship status, sexual orientation, disability, political affiliation or belief, or any other protected class. We are committed to the principles of Equal Opportunity Employment and are dedicated to making employment decisions based on merit and value, for ourselves, our client companies, and the candidates we represent. For opportunities located in a region that have enacted fair chance, arrest or conviction-based employment ordinances, Scion Staffing proactively follows the enacted guidance and considers for employment all qualified applications with arrest and conviction records. We engage in socially conscious business practices and believe that diverse, inclusive, and non-biased talent and recruitment processes are foundational to the success of Scion as well as every client organization with whom we partner.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on scionstaffing.com
Prepare application

Good distractions

Loading talks and stories from around this role…