Senior Data Engineer (5+ years)

Foresite Labs, LLC
San Francisco, CA, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$185,000.0 - $221,400.0
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Unix Information Engineering Extract Transform Load (ETL) Data Transformation Github Identity and Access Management Python (Programming Language) PostgreSQL SQL Databases Parquet
+10 more
Pulumi Business Intelligence Development Studio Large Language Models Apache Spark Generative AI Streamlit Framework Terraform Data Pipelines Serverless Computing Docker

Requirements

Do you have experience in UNIX?, * 5+ years of professional data engineering experience designing, building, and operating production pipelines end-to-end - including schema design for analytical workloads, entity resolution across messy real-world sources, and data quality enforcement at the pipeline level.

  • Deep fluency in Python and SQL, writing performant, well-tested data transformation code (dbt or similar), with production experience in pipeline orchestration (e.g., Airflow, Prefect) covering DAG design, scheduling, dependency management, retry/backfill patterns, and alerting.
  • Hands-on cloud data stack experience across AWS or GCP (e.g., managed Postgres, object storage, query engines, serverless ETL) and working knowledge of IAM, networking, and infrastructure patterns; comfortable with Spark or Trino at scale over Parquet/Iceberg. Terraform, CDK, or Pulumi experience is a plus.
  • Exposure to vector databases (Pinecone, pgvector, Weaviate, or similar) with an understanding of how embedding-based retrieval fits into LLM-powered applications.
  • Comfortable building and navigating Unix environments, containers (Docker), and CI/CD pipelines (GitHub Actions or similar).
  • Mindset for rapid and early-stage execution: bias for action, ownership of ambiguous problem spaces, and demonstrated ability to prioritize and wear multiple hats.
  • Strong written and verbal communication skills - comfortable explaining complex ideas clearly to technical and non-technical partners., * Familiarity with biomedical or life sciences data (e.g., clinical trials, genomics, drug discovery, pharma commercial data).
  • Familiarity with LLM application patterns: prompting, context engineering, tool use, structured outputs, retrieval-augmented generation (RAG).
  • Experience with dashboard/BI tooling (Streamlit, Retool, Metabase, or similar).

Benefits & conditions

Pulled from the full job description

  • Paid time off

Full job description

Foresite Labs is a translational R&D team that derives insights from precision measurement and population-scale biology and genetics to address unmet clinical needs. We use human genetics to systematically dissect and understand human disease biology and develop and critically evaluate therapeutic hypotheses. We engage in translational research, transforming basic insights into therapeutic opportunities. Our work supports drug discovery and company formation, and provides the core around which new ideas are realized and incubated. We offer competitive salaries, excellent benefits, a flexible work environment, and the opportunity to learn from top thinkers in various disciplines. Foresite Labs is headquartered in San Francisco and Boston.

What You’ll Do

  • Build and own production data infrastructure. Design, implement, and operate deterministic data pipelines that feed intelligence layers; ingest clinical, financial, scientific, and commercial data from REST APIs, XML feeds, and file-based sources into clean, queryable analytical layers; own the full lifecycle: pagination, rate limiting, auth, schema drift, idempotency, retries, monitoring, and alerting.
  • Model and curate high-quality data assets. Perform entity resolution, schema design, and quality enforcement across disparate and heterogeneous data sources; ensure downstream models, agents and dashboards operate on clean and trustworthy data.
  • Support AI-native workflows. Build vector infrastructure (e.g., embeddings, indexing, retrieval) and structured data interfaces that GenAI agents and LLM orchestrators depend on; ensure AI layers have the right data in the right shape at the right time.
  • Uphold high engineering standards and collaborate broadly. Lead code and design reviews, establish testing and observability best practices, and mentor peers; partner with ML engineers, computational biologists, and company founders to translate scientific and business goals into maintainable, and scalable technical solutions.
  • Leverage agentic coding tools (Claude Code, Codex, or similar) to accelerate prototyping, refactoring, and debugging., * Impact. Your code will accelerate discovery and bring novel therapeutics closer to patients and will help AI driven scientific innovation.
  • Autonomy. Small, senior teams give you room to architect and own end-to-end solutions without heavy bureaucracy.
  • Learning. Work at the intersection of software, cloud infrastructure, and biology alongside experts in each domain.
  • Flexibility & Benefits. Competitive salary and equity, comprehensive healthcare, generous PTO, and hybrid/remote options aligned to our SF or Boston hubs.
  • Ready to build? Apply today and help us create the software foundation that powers the next generation of companies advancing biotech and scientific innovation.

Location: San Francisco, CA

Salary range: $185,000 - $221,400

Foresite Labs is an equal opportunity employer. We thrive on diversity and collaboration.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:55 min

Contrasting Terraform with Pulumi and cloud-specific tools

Devlin Duldulao · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

2:03 min

Microsoft integrating native Unix coreutils into Windows environments

Chris Heilmann +2 · LIVE

3:20 min

Overview of infrastructure as code tools

Alexander Bubeck · WWC 2023

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · WWC Europe 2026

Videos

See all

Related articles

See all