Software Engineer, Lake & Warehouse Infrastructure

Datavant
San Francisco, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Junior

Job location

Remote
San Francisco, United States of America

Tech stack

Sql Data Warehouse
Artificial Intelligence
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Azure
Big Data
Google BigQuery
Code Review
Continuous Integration
Information Engineering
Data Governance
Data Infrastructure
Data Integration
Data Migration
Github
Identity and Access Management
Subnetting
Python
Routing
Operational Databases
Role-Based Access Control
Standard Sql
Software Engineering
Tableau
Snowflake
Spark
Amazon Web Services (AWS)
Data Lake
Kubernetes
Terraform
Looker Analytics
Redshift
Databricks

Job description

  • Architect, deploy, and maintain multiple big data platforms like Snowflake, Databricks, Redshift, BigQuery, etc.
  • Design and implement account and warehouse strategies, RBAC and data governance, and cost discipline
  • Own and evolve the Terraform that governs these platforms
  • Keep our 3rd party ecosystem like our data catalog and BI tools tightly integrated with all of our big data platforms
  • Build and operate the distributed S3 Iceberg lakehouse that bridges Snowflake, Databricks, and others without copying or moving data
  • Build selfservice tooling so analytics and product engineers can ship models and grants without becoming warehouse experts
  • Work crossfunctionally with BI&A, data science, and product teams to ensure that the data platform is exceeding their needs and supporting their ambitions
  • Own troubleshooting and incident response across our warehouses, data governance systems, and our Iceberg data lake
  • Set the bar on engineering quality, observability, cost discipline, and security in everything we ship

Requirements

  • 2+ years in data engineering, platform engineering, or data-focused software engineering
  • 2+ years of hands-on AWS with knowledge of networking (VPC, subnets, routing, PrivateLink, security groups) and IAM (roles, policies, permission boundaries)
  • 1+ years writing production Terraform or equivalent IaC: owning modules, reasoning about state and blast radius, shipping changes safely
  • 1+ years building self-service tooling, internal platforms, or paved path frameworks consumed by other engineers
  • Strong SQL and production experience with Snowflake (or an equivalent cloud data warehouse) RBAC, warehouse sizing, cost awareness, and reasoning about how data physically lives in a warehouse or lake
  • Solid CI/CD discipline in GitHub or equivalent: branching, code review, automated checks, repeatable deployment
  • An AI-native working style: capable of achieving great leverage through the smart application of AI to every aspect of work
  • Working knowledge of Python
  • Strong written and verbal communication skills, * Direct production experience with Iceberg or another open table format, especially bridging Snowflake and Databricks
  • Building platforms at large scale: Datavant has over 10,000 employees
  • Running a BI platform close to the warehouse (Sigma, Looker, Tableau, or similar)
  • Hands-on Databricks or Spark
  • Kubernetes experience
  • Snowflake or Databricks certification(s)
  • Azure or GCP experience -- we're primarily AWS, but our customers and acquisitions aren't always
  • Integrating data systems with managed identity platforms, particularly via SCIM
  • Prior experience in healthcare or another highly regulated industry like Finance
  • Prior DBA, SRE, or DRE work operating production data systems under pressure

Benefits & conditions

Datavant Ireland is an innovative R&D technology center based in Galway, dedicated to solving complex technology challenges with a purpose. We are looking for talented technical professionals who are product-minded and eager to make an impact. If you are passionate about developing cutting-edge solutions and want to be part of a growing team, we invite you to explore the exciting career opportunities at Datavant.

Careers at Datavant offer the opportunity to apply your technology and problem-solving skills toward a vision that every healthcare decision is powered by the right data, at the right time, in the right format. We're looking for problem-solvers, game-changers, innovators, dreamers, doers-people who are ready to move the needle and build on our success.

We provide team members with a robust total compensation package that includes:

  • Competitive, equitable salary.
  • Comprehensive benefits.
  • Pension contribution.
  • Flexible, Hybrid work environment.

We are committed to building a diverse team of Datavanters who are all responsible for stewarding a high-performance culture in which all Datavanters belong and thrive.

We are proud to be an Equal Employment Opportunity employer. Datavant is committed to working with and providing reasonable accommodations to individuals with physical and mental disabilities. If you need an accommodation while seeking employment, please request it here, by selecting the 'Interview Accommodation Request' category. You will need your requisition ID when submitting your request, you can find instructions for locating it here. Requests for reasonable accommodations will be reviewed on a case-by-case basis.

About the company

Datavant is the data collaboration platform trusted for healthcare. Guided by our mission to make the world's health data secure, accessible and actionable, we provide critical data solutions for organizations across the healthcare ecosystem - including providers, health plans, researchers, and life sciences companies. From fulfilling a single patient's request for their medical records to powering the AI revolution in healthcare, Datavanters are building the future of how data is connected and used to improve health. By joining Datavant today, you're stepping onto a driven and highly collaborative team that is passionate about creating transformative change in healthcare. This role is for an engineer who thinks like a platform builder first. We are shifting from a serviceoriented posture ("we'll build the pipeline for you") to a platformoriented one ("here is the paved path to build it yourself, safely"), though the team still builds pipelines directly when the situation calls for it. You will be central to that shift, designing the frameworks, tooling, and guardrails that scale how Datavant onboards new sources, and rolling up your sleeves for handson ingestion work when there isn't yet a paved path. AI fluency is a baseline expectation here. You should already be using Claude Code, Cursor, Copilot, or equivalent tools as a core part of your daily engineering workflow, have opinions about how they make a team faster, and know how to apply them responsibly when PHI and other sensitive data are in scope., About Datavant 51-200, Datavant is a provider of a healthcare data solutions to help institutions share, protect, and match health data.

Apply for this position