Staff Engineer, Data Platform

Lila Sciences, Inc.
Cambridge, United States of America
14 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 272K

Job location

Cambridge, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Architectural Patterns
Cloud Computing
Data Governance
Data Infrastructure
Data Security
Data Systems
Cursor (Graphical User Interface Elements)
Fault Tolerance
Python
Machine Learning
NoSQL
Query Optimization
Scientific Computating
Software Engineering
SQL Databases
Unstructured Data
Large Language Models
Data Lake
Core Data
Kubernetes
Storage Technologies
Information Technology
Production Code
Machine Learning Operations

Job description

We are looking for a Staff Engineer to set the technical direction for our core data infrastructure: ingestion frameworks, storage architecture, orchestration patterns, and the interfaces that let scientists and ML researchers work with data reliably at scale. You will work closely with software engineers, machine learning researchers, and lab scientists to understand requirements and translate them into durable platform capabilities.

This is a role for engineers who care deeply about how data systems are designed. You will establish the architectural patterns and engineering standards the broader team builds on, mentor engineers across the data platform group, and make technical decisions that compound over time.

What You'll Be Building

  • Data Platform Architecture: Design and evolve the core data infrastructure that ingests, stores, and serves data across scientific and ML workflows. Make principled build-vs-buy decisions and establish architectural patterns adopted by the broader engineering organization.
  • Ingestion and Integration: Build reliable pipelines that bring in data from diverse sources: laboratory instruments, public scientific datasets, and external research literature. Own the interfaces between upstream producers and downstream consumers.
  • Orchestration and Reliability: Operate and extend workflow orchestration systems that run complex, multi-step scientific pipelines. Ensure observability, fault tolerance, and reproducibility across the data stack.
  • Data Modeling and Schema Strategy: Define and maintain data models, schema evolution practices, and data contracts that ensure consistency, discoverability, and long-term durability of scientific and platform data assets.
  • Cross-Functional Technical Leadership: Partner with ML researchers, lab scientists, and product engineers to translate scientific and research requirements into platform capabilities. Drive alignment on data standards and integration patterns across teams.
  • Engineering Standards and Mentorship: Establish coding, review, and design standards for the data platform team. Mentor engineers, lead design reviews, and raise the technical bar across the group.

Requirements

Do you have experience in Software engineering?, * Bachelor's or Master's degree in Computer Science, Engineering, or a related field, and 8+ years as a software or data engineer with a focus on building and operating data infrastructure.

  • Designed and shipped data platform components from the ground up, including ingestion frameworks, storage abstractions, and orchestration systems. Fluent in Python and SQL and writes production-quality code.
  • Production experience with relational and NoSQL databases, schema design, query optimization, and operational concerns at scale. Comfortable working across structured, semi-structured, and unstructured data.
  • Proven track record of working cross-functionally with scientists, ML researchers, and engineers. Able to translate domain requirements into platform decisions and explain technical trade-offs to diverse audiences.
  • Experience with cloud infrastructure and containerized deployment (AWS, Kubernetes).
  • Hands-on experience with modern table formats and open lakehouse patterns (Iceberg, Delta Lake, Hudi).

Bonus Points For

  • Experience with workflow orchestration systems (Flyte, Airflow, Dagster, or similar).
  • Experience building data infrastructure that serves agentic and LLM-driven workflows, including vector databases, RAG infrastructure, and retrieval-optimized data access patterns.
  • Background in scientific computing, life sciences, or research software.
  • Proficiency with AI-assisted development tools (Cursor, Claude Code, or similar) and ability to incorporate them effectively into day-to-day engineering work.

Benefits & conditions

Pulled from the full job description

  • Tuition reimbursement
  • Paid parental leave
  • Parental leave
  • Health insurance
  • Vision insurance
  • Dental insurance
  • Disability insurance, We offer competitive base compensation with bonus potential and generous early-stage equity. Your final offer will reflect your background, expertise, and expected impact.

U.S. Benefits. Full-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program.

International Benefits. Full-time employees outside the U.S. receive a comprehensive benefits program tailored to their region. USD salary ranges apply only to U.S.-based positions; international salaries are set to local market.

Expected Base Salary Range

$192,000 - $272,000 USD

About the company

Lila Sciences is building the software platform that makes automated scientific discovery possible. At the heart of that platform is data: raw outputs from laboratory instruments, experimental model results, curated public datasets, and the scientific literature that contextualizes all of it. The data platform team is responsible for the infrastructure that moves, stores, transforms, and surfaces this data across the organization., Lila Sciences is building Scientific Superintelligence to solve humankind's greatest challenges. We believe science is the most inspiring frontier for AI. Rather than hard-coding expert knowledge into tools, LILA builds systems that can learn for themselves. LILA combines advanced AI models with proprietary AI Science Factory instruments into an operating system for science that executes the entire scientific method autonomously, accelerating discovery at unprecedented speed, scale, and impact across medicine, materials, and energy. Learn more at www.lila.ai. Guided by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance. If this sounds like an environment you'd love to work in, even if you don't meet every qualification listed above, we encourage you to apply.

Apply for this position