Senior Data Engineer, IT Enterprise Data Solutions

Bill & Melinda Gates Foundation
Seattle, WA, United States
16 days ago
Apply on gatesfoundation.wd1.myworkdayjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$157,400.0 - $236,000.0
Working hours
Regular working hours

Tech stack

Sql Data Warehouse Microsoft Access Microsoft Excel Application Programming Interfaces (APIs) Artificial Intelligence Data Analysis JIRA Automation of Tests Business Systems Cloud Computing Cloud Database Cloud Engineering
+46 more
Cyber Security Information Systems Databases Continuous Integration Data Architecture Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Normalization Data Security Data Sharing Data Systems Data Warehousing Relational Databases Dimensional Modeling Electronic Data Interchange (EDI) JSON Python (Programming Language) Key Management Knowledge Management Metadata Operational Databases Scrum Methodology Release Management Power BI SQL Databases Data Streaming Unstructured Data Extensible Markup Language (XML) Enterprise Search Enterprise Data Management Data Logging Data Processing Enterprise Software Applications Document Metadata Azure Data Factory Retrieval-Augmented Generation System Availability Snowflake Apache Spark Pyspark Information Technology Collibra Software Version Control Devsecops Databricks

Job description

As a Senior Data Engineer, you will design, build, operate, and continuously improve secure, scalable, and reliable data solutions on the foundation’s Modern Data Platform. You will be a senior hands-on engineer and domain expert who translates business and technical requirements into production-ready pipelines, data products, models, and platform capabilities.

You will work with data and AI engineers, business systems analysts, product owners, data analysts, BI engineers, security specialists, and service partners. Your work will improve the availability, quality, lineage, and usability of data for reporting, search, AI-assisted knowledge discovery, retrieval-augmented generation, and other data-driven decision-making across the foundation and its affiliates.

*This is a Seattle based role.

What You’ll Do

  • Data Engineering & Solution Delivery

Design, develop, test, deploy, and support configuration-driven ELT/ETL pipelines that acquire data from enterprise applications, databases, APIs, file repositories, partner data sources, and shared data exchanges.

Build reusable ingestion and transformation patterns for structured, semi-structured and unstructured data, including relational data, JSON, XML, CSV, Excel, and document metadata.

Develop curated data products and dimensional models using star and snowflake techniques to support enterprise reporting, semantic models, analytics, and downstream operational use cases.

Implement transformations using SQL, Python, Spark/PySpark, Databricks notebooks, dbt Cloud, Snowpark, and related cloud-native engineering tools.

Contribute hands-on to modernization initiatives, including migration from legacy data warehouse and ETL patterns to lakehouse, cloud warehouse, and ELT-based architectures.

  • Platform Reliability, Security & Operations

Monitor and optimize pipelines, storage, compute, and databases for performance, scalability, availability, and cost efficiency.

Implement data quality controls, reconciliation, exception handling, observability, logging, alerting, and service-level measures for critical data flows.

Lead or support incident triage, root-cause analysis, restoration, and follow-through on preventive actions for production data services.

Apply secure engineering practices including managed identity, role-based access, encryption, secrets management, least-privilege access, and sensitive-data handling requirements.

Implement and maintain CI/CD, automated testing, version control, release management, and environment promotion practices for data workloads.

  • AI, Search & Advanced Analytics Enablement

Engineer governed, high-quality data and document pipelines that support enterprise search, AI-assisted knowledge discovery, retrieval-augmented generation, analytics, and data science use cases.

Prepare and curate source data, metadata, permissions, lineage, and quality signals needed for reliable AI solutions while preserving source-system security and access policies.

Partner with Knowledge Management, AI, Business Intelligence, and Information Security teams to define fit-for-purpose data products for model grounding, evaluation, and responsible use.

Help establish repeatable patterns for document ingestion, chunking-ready content preparation, semantic metadata, and controlled data exchange across internal teams and affiliates.

Evaluate emerging data and AI platform capabilities through proofs of concept and recommend adoption based on value, security, sustainability, and architectural fit.

  • Engineering Excellence & Collaboration

Conduct design and code reviews, contribute to engineering standards, and promote reusable patterns for data modeling, orchestration, testing, observability, and documentation.

Collaborate with architects and product teams to clarify requirements, assess trade-offs, estimate delivery, and convert solution designs into actionable implementation plans.

Mentor data engineers and contingent staff through pairing, technical guidance, review, and knowledge sharing; may coordinate work across small delivery efforts.

Create and maintain technical documentation, runbooks, data mappings, lineage, and operational procedures; contribute metadata and descriptions for synchronization with Collibra.

Work effectively in Agile delivery teams using Scrum, Jira, and DevSecOps practices while communicating clearly with technical and non-technical partners.

Requirements

  • Bachelor’s degree in computer science, data engineering, information systems, or a related field, or equivalent combination of education and experience.
  • Typically 7+ years of relevant data engineering experience in enterprise environments, including designing, delivering, and operating production data platforms and pipelines.
  • Strong hands-on expertise with Azure data services, Databricks, Snowflake, and dbt Cloud; experience with Azure Data Factory and Fivetran is strongly preferred.
  • Advanced proficiency in SQL and Python, plus practical experience with Spark/PySpark or Scala and cloud scripting or automation.
  • Experience implementing lakehouse, cloud data warehouse, ELT/ETL, and medallion or layered data architecture patterns.
  • Demonstrated experience with dimensional modeling, data normalization, slowly changing dimensions, point-in-time history, and enterprise data quality practices.
  • Experience building CI/CD pipelines for data workloads, automated testing, infrastructure-as-code or configuration-as-code, and modern version control workflows.
  • Strong understanding of data security, privacy, access controls, encryption, lineage, retention, and governance in cloud data environments.
  • Experience supporting analytics and semantic-layer platforms such as Power BI, and working with metadata/governance platforms such as Collibra, is preferred.
  • Demonstrated ability to enable AI through data, including an understanding of the architecture, quality, metadata, permissions, lineage, scalability, and evaluation requirements for search, RAG, and other AI use cases.
  • Proven ability to diagnose production issues, lead technical problem solving, and implement short-, medium-, and long-term corrective actions.
  • Experience working with vendors or distributed engineering teams and reviewing deliverables for alignment with enterprise standards and maintainability.
  • Excellent written and verbal communication skills, sound judgment, and the ability to explain complex technical concepts to varied audiences.
  • A demonstrated commitment to diversity, equity, inclusion, and respectful collaboration.

*Must have unrestricted work authorization in the country where this position is located.

The Foundation does not provide immigration-related sponsorship for this role. This includes direct company sponsorship and any work authorization requiring a written submission or other immigration support from the company (eg: H-1B, O-1, L-1, E, OPT, STEM-OPT, CPT, TN, J-1, etc.).

Benefits & conditions

The salary range for this role is $157,400 to $236,000 USD. We recognize high-wage market differences in Seattle and Washington D.C., where our offices are located. The range for this role in these locations is $173,100 to $259,700 USD. As a mission-driven organization, we strive to balance competitive pay with our mission. New hires salaries are typically between the range minimum and the salary range midpoint. Actual placement in the range will depend on a candidate’s job-related skills, experience, and expertise, as evaluated during the interview process.

About the company

We are the largest nonprofit fighting poverty, disease, and inequity around the world. Founded on a simple premise: people everywhere, regardless of identity or circumstances, should have the chance to live healthy, productive lives. We believe our employees should reflect the rich diversity of the global populations we aim to serve. We provide an exceptional benefits package to employees and their families which include comprehensive medical, dental, and vision coverage with no premiums, generous paid time off, paid family leave, foundation-paid retirement contribution, regional holidays, and opportunities to engage in several employee communities. As a workplace, we’re committed to creating an environment for you to thrive both personally and professionally.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on gatesfoundation.wd1.myworkdayjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:03 min

Distinguishing type definition constructs from data validation routines

Clemens Vasters Clemens Vasters · World Congress 2025

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

Videos

See all

Related articles

See all