Senior Data Engineer (5+ years)

Foresite Labs, LLC
San Francisco, United States of America
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 221K

Job location

Remote
San Francisco, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Unix
Information Engineering
ETL
Data Transformation
Github
Identity and Access Management
Python
PostgreSQL
SQL Databases
Parquet
Pulumi
Business Intelligence Development Studio
Large Language Models
Spark
Generative AI
Streamlit Framework
Terraform
Data Pipelines
Serverless Computing
Docker

Requirements

Do you have experience in UNIX?, * 5+ years of professional data engineering experience designing, building, and operating production pipelines end-to-end - including schema design for analytical workloads, entity resolution across messy real-world sources, and data quality enforcement at the pipeline level.

  • Deep fluency in Python and SQL, writing performant, well-tested data transformation code (dbt or similar), with production experience in pipeline orchestration (e.g., Airflow, Prefect) covering DAG design, scheduling, dependency management, retry/backfill patterns, and alerting.
  • Hands-on cloud data stack experience across AWS or GCP (e.g., managed Postgres, object storage, query engines, serverless ETL) and working knowledge of IAM, networking, and infrastructure patterns; comfortable with Spark or Trino at scale over Parquet/Iceberg. Terraform, CDK, or Pulumi experience is a plus.
  • Exposure to vector databases (Pinecone, pgvector, Weaviate, or similar) with an understanding of how embedding-based retrieval fits into LLM-powered applications.
  • Comfortable building and navigating Unix environments, containers (Docker), and CI/CD pipelines (GitHub Actions or similar).
  • Mindset for rapid and early-stage execution: bias for action, ownership of ambiguous problem spaces, and demonstrated ability to prioritize and wear multiple hats.
  • Strong written and verbal communication skills - comfortable explaining complex ideas clearly to technical and non-technical partners., * Familiarity with biomedical or life sciences data (e.g., clinical trials, genomics, drug discovery, pharma commercial data).
  • Familiarity with LLM application patterns: prompting, context engineering, tool use, structured outputs, retrieval-augmented generation (RAG).
  • Experience with dashboard/BI tooling (Streamlit, Retool, Metabase, or similar).

Benefits & conditions

Pulled from the full job description

  • Paid time off

 

Full job description

Foresite Labs is a translational R&D team that derives insights from precision measurement and population-scale biology and genetics to address unmet clinical needs. We use human genetics to systematically dissect and understand human disease biology and develop and critically evaluate therapeutic hypotheses. We engage in translational research, transforming basic insights into therapeutic opportunities. Our work supports drug discovery and company formation, and provides the core around which new ideas are realized and incubated. We offer competitive salaries, excellent benefits, a flexible work environment, and the opportunity to learn from top thinkers in various disciplines. Foresite Labs is headquartered in San Francisco and Boston.

What You'll Do

  • Build and own production data infrastructure. Design, implement, and operate deterministic data pipelines that feed intelligence layers; ingest clinical, financial, scientific, and commercial data from REST APIs, XML feeds, and file-based sources into clean, queryable analytical layers; own the full lifecycle: pagination, rate limiting, auth, schema drift, idempotency, retries, monitoring, and alerting.
  • Model and curate high-quality data assets. Perform entity resolution, schema design, and quality enforcement across disparate and heterogeneous data sources; ensure downstream models, agents and dashboards operate on clean and trustworthy data.
  • Support AI-native workflows. Build vector infrastructure (e.g., embeddings, indexing, retrieval) and structured data interfaces that GenAI agents and LLM orchestrators depend on; ensure AI layers have the right data in the right shape at the right time.
  • Uphold high engineering standards and collaborate broadly. Lead code and design reviews, establish testing and observability best practices, and mentor peers; partner with ML engineers, computational biologists, and company founders to translate scientific and business goals into maintainable, and scalable technical solutions.
  • Leverage agentic coding tools (Claude Code, Codex, or similar) to accelerate prototyping, refactoring, and debugging., * Impact. Your code will accelerate discovery and bring novel therapeutics closer to patients and will help AI driven scientific innovation.
  • Autonomy. Small, senior teams give you room to architect and own end-to-end solutions without heavy bureaucracy.
  • Learning. Work at the intersection of software, cloud infrastructure, and biology alongside experts in each domain.
  • Flexibility & Benefits. Competitive salary and equity, comprehensive healthcare, generous PTO, and hybrid/remote options aligned to our SF or Boston hubs.
  • Ready to build? Apply today and help us create the software foundation that powers the next generation of companies advancing biotech and scientific innovation.

Location: San Francisco, CA

Salary range: $185,000 - $221,400

Foresite Labs is an equal opportunity employer. We thrive on diversity and collaboration.

Apply for this position