> Markdown version of [/jobs/ext/2742211-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2742211-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Flagship Pioneering, Inc. - **Location:** United States - **Experience:** Expert - **Salary:** $128,000.0 - $176,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Clinical Data Repository, Continuous Integration, Data Architecture, Information Engineering, Data Infrastructure, Data Integration, Data Transformation, Data Warehousing, JSON, Python (Programming Language), Metadata, Scrum Methodology, Release Management, Cloud Services, SQL Databases, Unstructured Data, Web Application Frameworks, Parquet, Data Processing, Data Storage Technologies, Apache Spark, Backend, Git, Containerization, Data Lakes, Data Analytics, GPT, Data Pipelines, Docker - **Published:** September 6, 2026 - **Apply:** https://startup.jobs/lead-data-engineer-flagship-pioneering-inc-9939694 ## About the Role * 6+ years of hands-on experience in data engineering, preferably in life sciences, biotech, or healthcare environments. * Proven expertise in designing and operating cloud-native data architectures, particularly within AWS. * Advanced proficiency in Python and SQL for data manipulation, pipeline development, and system automation. * Extensive experience with modern frameworks and tools such as Dagster, dbt, Spark, Iceberg, Lake Formation, Athena, Glue, etc. * Strong experience with Git, CI/CD, CDK, containerized workloads, Docker, and ECS. * Experience supporting both structured and unstructured data (CSV, JSON, Parquet, imaging, etc.). * Demonstrated success in leading complex, cross-functional projects involving technical and scientific stakeholders. * Practical experience using generative AI tools (e.g., Claude Code, GPT-based tools, etc.) to boost engineering velocity and reduce boilerplate. * A track record of leading complex technical initiatives under ambiguity, making explicit trade-offs and remaining accountable for reliable operational outcomes. PREFERRED QUALIFICATIONS * Experience supporting bioinformatics, cheminformatics, or clinical data workflows. * Familiarity with scientific software and ELN's, particularly Benchling and CDD. * Exposure to Agile or Scrum-based development methodologies. * Relevant certifications (e.g., AWS Solutions Architect Associate, Data Analytics Specialty). ## Description We are seeking a Lead Data Engineer to lead complex initiatives aimed at modernizing and professionalizing our data infrastructure, platforms, and pipelines. You will lead the implementation of core platform systems and help to set the directions and standards of our data infrastructure and pipelines. You will work closely with other engineers and stakeholders across Infrastructure & Operations (I&O), Lab IT, Pioneering Intelligence (PI) Tech, and the internal scientific community to turn evolving scientific needs into secure, reliable and scalable data engineering solutions. Reporting into the Associate Director, Data Architecture & Engineering, this is a technical, senior individual-contributor role that will champion engineering best practices, build complex data pipelines, lead data platform implementations, and handle the troubleshooting and optimization of data warehouse and storage solutions. CORE RESPONSIBILITIES Data & Platform Engineering * Serve as the technical lead and subject matter expert on complex data engineering projects involving interdependent systems, legacy environments, and emerging cloud-first platforms. * Lead the implementation of data infrastructure, platforms, tools, and other data products. * Lead the optimization and reliability of data storage solutions (lakehouses, marts, warehouses, etc.). * Implement complex backend and data integration pipelines to support data lakes, marts, and other platforms. * Establish and reinforce engineering standards for testing, documentation, release management, and monitoring across the team. * Lead implementations for platform observability, management, resilience, capacity, and performance. * Diagnose and resolve complex failures spanning infrastructure and data pipelines; lead incident reviews and ensure corrective actions improve the wider system. Cross-Functional Collaboration & Technical Leadership * Collaborate across I&O, Lab IT, PI Tech, data science, and bioinformatics teams to ensure architectural alignment, reuse of components, and shared understanding of system states and dependencies. * Mentor junior engineers and establish engineering standards that drive excellence, reproducibility, and innovation across the team. * Leverage generative AI tools and frameworks to accelerate pipeline development, data transformation, and metadata enrichment at scale. ## Related Videos - [ Evaluating AI models for code comprehension](https://www.wearedevelopers.com/videos/1462-evaluating-ai-models-for-code-comprehension) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Blueprints for Success: Steering a Global Data & AI Architecture](https://www.wearedevelopers.com/videos/1577-blueprints-for-success-steering-a-global-data-ai-architecture) - [Streaming AI Responses in Real-Time with SSE in Next.js & NestJS](https://www.wearedevelopers.com/videos/1630-streaming-ai-responses-in-real-time-with-sse-in-next-js-nestjs) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)