Senior Data Engineer

Quantiphi, Inc.
United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Big Data BigQuery Clinical Data Repository Cloud Computing Continuous Integration Information Engineering Data Governance Data Infrastructure Data Integration
+22 more
Extract Transform Load (ETL) Data Warehousing Data Flow Control Interoperability Python (Programming Language) PostgreSQL Performance Tuning Cloudera SQL Databases Data Streaming Fast Healthcare Interoperability Resources Snowflake Grafana Electronic Medical Records Build Management Pyspark AWS Glue Health Level Seven International Data Management Stream Processing Data Pipelines Amazon Redshift

Job description

As a Senior Data Engineer, you will design and build scalable, production-grade data platforms and pipelines that power AI and analytics use cases. This role is highly hands-on and sits at the intersection of data engineering, AI enablement, and cloud platforms.

You will work closely with clients and internal stakeholders to build modern data ecosystems, with a strong focus on healthcare data and interoperability standards., * Design and build scalable data pipelines (ETL/ELT) using modern data engineering frameworks

  • Develop and optimize batch and real-time data processing systems
  • Build and maintain data integration workflows across multiple systems and sources
  • Ensure data quality, integrity, and reliability across the data lifecycle
  • Work with large-scale structured and semi-structured datasets
  • Optimize data pipelines for performance, scalability, and cost efficiency
  • Collaborate with stakeholders to translate business needs into technical solutions
  • Design and implement data models to support analytics and AI use cases
  • Support healthcare data ingestion and transformation, including interoperability standards
  • Maintain best practices for CI/CD, testing, and monitoring of data pipelines

Requirements

  • 7+ years of experience in Data Engineering or Data Platform development
  • Strong hands-on experience with at least one of:
  • Python
  • SQL
  • PySpark
  • Experience working with at least one of the following data platforms:
  • Snowflake
  • PostgreSQL
  • BigQuery
  • Amazon Redshift
  • Experience building and maintaining data pipelines using one or more of:
  • ETL / ELT frameworks
  • dbt
  • Dataflow, Dataproc, EMR, or AWS Glue
  • General data pipeline / data integration frameworks
  • Strong SQL expertise (joins, window functions, performance tuning)
  • Experience working with large-scale data processing systems

Other Qualifications (OQs):

  • Experience with cloud platforms (AWS, GCP, or Azure)
  • Familiarity with real-time or streaming data architectures
  • Exposure to modern data stack tools and best practices
  • Experience with data governance, data quality, and observability tools
  • Strong communication skills and experience working with cross-functional teams

Domain Experience (Required):

  • Experience working within Healthcare domain, specifically:
  • Healthcare providers or payer systems
  • Healthcare datasets (EHR/EMR)
  • Familiarity with healthcare interoperability standards such as:
  • HL7 (v2 preferred)
  • FHIR (nice to have)
  • Experience working with systems such as:
  • Epic (preferred)
  • Other clinical or healthcare data platforms

About the company

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

About Quantiphi:

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate - we lead.

Headquartered in Boston, with 4,000+ professionals across the globe. Quantiphi leverages Applied AI technologies across multiple a. Industry Verticals (Telco, BFSI, HCLS etc.) and is an established Elite/Premier Partner of NVIDIA, Google Cloud, AWS, Snowflake, and others.

We’ve been recognized with:

  • 17x Google Cloud Partner of the Year awards in the last 8 years.
  • 3x AWS AI/ML award wins.
  • 3x NVIDIA Partner of the Year titles.
  • 2x Snowflake Partner of the Year awards.
  • We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.
  • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.
  • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation., What’s in it for YOU at Quantiphi:

  • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.
  • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.
  • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.
  • Stay ahead of the curve-immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

1:04 min

Visualizing Keycloak performance via standard Grafana troubleshooting dashboards

Alexander Schwartz Alexander Schwartz · World Congress 2025

Videos

See all

Related articles

See all