> Markdown version of [/jobs/ext/2499893-senior-software-engineer-data-platform](https://www.wearedevelopers.com/jobs/ext/2499893-senior-software-engineer-data-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Engineer, Data Platform - **Company:** Harvey, Inc. - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Salary:** $193,400.0 - $290,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Data Analysis, Application Frameworks, Microsoft Azure, BigQuery, Cloud Database, Computer Programming, Data Governance, Data Infrastructure, Python (Programming Language), Operational Databases, Performance Tuning, Pulumi, Data Processing, Google Cloud, Sql Optimization, Snowflake, Data Lakes, Debezium, Kubernetes, Apache Flink, Apache Kafka, Spark Streaming, Terraform, Stream Processing, Databricks - **Published:** August 25, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=edcca601c37b3df4 ## About the Role * 5+ years building and operating production data infrastructure, with ownership of systems other teams depend on * Deep experience with cloud data warehouses - Snowflake strongly preferred (BigQuery, Databricks, or Redshift experience transfers well) - including performance tuning and cost management * Hands-on experience building CDC and streaming pipelines with technologies like Kafka, Debezium, Flink, or Spark Streaming * Experience with managed ingestion tooling (Fivetran, Airbyte, or similar) and clear judgment about when to buy the connector and when to build it * Strong fluency with workflow orchestration - Temporal, Airflow, Dagster, or similar - operated at scale, not just configured * Strong programming skills in Python and advanced SQL * Experience building frameworks or internal tooling that other engineers use, and the product instinct to know when an abstraction is helping versus getting in the way * Practical experience with data quality, observability, and lineage tooling, and with schema evolution in systems that can't afford downtime * Working knowledge of data governance in a regulated environment: PII classification, masking, access control, retention, and data residency * Familiarity with cloud data services (Azure, AWS, GCP), Kubernetes, and infrastructure-as-code (Terraform, Pulumi) * Comfort operating in ambiguity and defining scope where none exists Nice to Have * Experience with dbt and a close working relationship with analytics engineering teams * Experience with lakehouse architectures and open table formats (Iceberg, Delta Lake) or query engines like Trino * Experience operating multi-tenant platforms with strict security, compliance, or data residency requirements * Exposure to data infrastructure for AI products * Prior experience as an early or founding data platform hire at a fast-growing company ## Description * Own the data platform's architecture and technical direction - treating data infrastructure as a software product built from reusable frameworks, and making deliberate build-vs-buy tradeoffs as the platform grows * Build and operate the ingestion layer across streaming, batch, CDC, and third-party connectors, including schema evolution that absorbs upstream change safely rather than silently breaking consumers, so onboarding a new source is a paved path instead of a project * Land data into Snowflake with the freshness, completeness, and cost characteristics downstream consumers can plan around, and define a clean handoff for Analytics Engineering * Own the orchestration platform - scheduling, retries, backfills, and dependency management across the full data graph * Build the transformation and compute frameworks teams can use to process data at scale, and the self-serve tooling that lets product engineers and analysts stand up their own pipelines against primitives you've already made safe * Design and operate stream processing infrastructure for use cases that can't wait for batch - real-time product features, operational alerting, and near-live reporting * Build the trust layer: quality and observability (freshness, validation, reconciliation, anomaly detection, alerting routed to the right owner) alongside lineage, cataloging, and discovery, so anyone can find data and know where it came from and what depends on it * Build the patterns and tooling for PII and sensitive data - classification, masking, retention, access control - and for multi-region residency requirements * Set the technical bar for data at Harvey through design reviews, standards, documentation, and mentorship as the team grows ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Python-Based Data Streaming Pipelines Within Minutes](https://www.wearedevelopers.com/videos/1233-python-based-data-streaming-pipelines-within-minutes) - [Why segmenting your infrastructure into tiers makes your infrastructure design better](https://www.wearedevelopers.com/videos/1960-why-segmenting-your-infrastructure-into-tiers-makes-your-infrastructure-design-better) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)