> Markdown version of [/jobs/ext/2203760-data-engineer-data-platform-organization](https://www.wearedevelopers.com/jobs/ext/2203760-data-engineer-data-platform-organization). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Data Platform Organization - **Company:** Zipline - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Salary:** $160,000.0 - $200,000.0 - **Contract:** Permanent contract - **Skills:** Query Performance, Airflow, Amazon Web Services, Systems Engineering, Cloud Computing, Information Engineering, Data Files, Data Infrastructure, Data Warehousing, Distributed Systems, Python (Programming Language), Metadata, Cloud Services, DataOps, Software Engineering, Management of Software Versions, Workflow Management Systems, Scripting, Data Ingestion, Snowflake, Concurrency, Safety Critical Systems, Kubernetes, Star Schema - **Published:** August 23, 2026 - **Apply:** https://www.careerbuilder.com/job-details/senior-data-engineer-data-platform-san-francisco-ca--155a73a4-aed3-415f-83cd-bc59f416f989 ## About the Role * 5+ years of professional software or data engineering experience, including production systems built primarily with Python or Rust. * Strong distributed-systems and data-systems foundations, with hands-on experience building and operating pipelines and data infrastructure at scale. * Experience with cloud infrastructure and production operations, ideally AWS and Kubernetes, plus workflow orchestration tools such as Prefect or Airflow. * Experience with modern data warehouses, preferably Snowflake, and lakehouse table formats, data modeling, and transformation workflows such as dbt. * Demonstrated judgment on cost, performance, and reliability, including production guardrails, backfills, idempotency, retries, safe deployments, and data-outage runbooks. * Clear technical communication and influence. Experience with high-volume telemetry or sensor data, data observability, infrastructure-as-code, or safety-critical systems is strongly preferred. * This is a full-time role based in South San Francisco., Amazon Web Services (AWS), Building Systems, Cloud Computing, Communication Skills, Concurrency, Data Formats, Data Modeling, Data Science, Data Sets, Data Warehousing, Distributed Computing, Embedded Systems, Engineering, Government Reporting, Healthcare, Identify Issues, International Operations, Logistics, Medical Products, Medicine, Metadata, Problem Solving Skills, Production Systems, Python Programming/Scripting Language, Restaurant, Retail, Safety Codes, Safety Systems, Sculpture, Snowflake Schema, Software Engineering, System Operations, Systems Engineering, Technical Leadership, Telemetry, Unmanned Aircraft Systems (UAS), Vaccination, Warehousing ## Description Zipline builds, manufactures, and operates autonomous delivery systems that move essential goods where they are needed. As a Senior Data Engineer on the Data Platform team, you will build cloud data foundations that turn application and operational telemetry into trusted inputs for delivery-system decisions, product analytics, and ML. You will own the data backbone across ingestion, orchestration, lakehouse and warehouse systems, and shared engineering standards. Success means making operational telemetry and downstream datasets dependable, discoverable, performant, and cost-conscious for the teams building and operating Zipline's delivery system. What You'll Do * Design and operate cloud services for data ingestion, transformation, validation, and serving across batch and near-real-time pipelines. * Build orchestration patterns and shared libraries, templates, CI checks, and golden paths that standardize dataset publishing and transformations. * Own lakehouse and warehouse foundations, including table management, schema evolution, partitioning, workload isolation, access patterns, and lifecycle management. * Establish data contracts, metadata, naming, versioning, lineage, freshness, quality checks, and service objectives tied to operational and business impact. * Diagnose distributed-system bottlenecks and improve throughput, query performance, concurrency, storage efficiency, and infrastructure or warehouse cost. * Partner with service, telemetry, embedded, analytics, data science, and ML teams; lead technical reviews and align teams on durable platform interfaces and tradeoffs. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) - [Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies](https://www.wearedevelopers.com/videos/251-remote-driving-on-plant-grounds-with-state-of-the-art-cloud-technologies) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [DevOps Engineer Salary [2023]](https://www.wearedevelopers.com/magazine/203-devops-engineer-salary-2023) - [Highest Paying Tech Companies in Europe](https://www.wearedevelopers.com/magazine/162-highest-paying-tech-companies-in-europe)