Sr Data Engineer

Pediatric Associates
United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Microsoft Azure Cloud Computing Computer Programming Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Transformation Data Structures Data Systems Data Warehousing
+14 more
Dimensional Modeling Python (Programming Language) Power BI SQL Databases Data Processing Scripting Azure Data Factory Snowflake Apache Spark Data Strategy Star Schema Azure Synapse Analytics Data Pipelines Databricks

Job description

The Data Engineer is responsible for building, maintaining, and optimizing reliable ELT/ETL workflows that support enterprise-wide data and analytics requirements. This role focuses on hands-on development of data pipelines, data models, and transformation logic to ensure high-quality, accessible, and well-structured data for analytical and operational use cases. The Data Engineer works closely with data analysts, data scientists, product managers, and business stakeholders to understand requirements, contribute to technical solution design, and implement robust data engineering capabilities. The ideal candidate can translate business needs into technical specifications, write efficient SQL and Python code, and apply modern data engineering best practices across cloud-based environments. Key Responsibilities Develop, maintain, and optimize scalable ELT/ETL pipelines using modern data engineering tools and frameworks. Implement and refine data models, schemas, and data structures to support

Requirements

analytics, reporting, and operational workloads. Participate in solution design discussions, contributing to data strategies and technical decisions. Create and maintain high-quality SQL queries, transformation logic, and reusable data processing components. Ensure data quality by implementing validation rules, profiling checks, monitoring, and reconciliation processes. Collaborate with cross-functional teams to gather requirements, troubleshoot issues, and deliver reliable data solutions. Monitor pipeline performance, address failures, and continuously improve reliability, cost, and scalability. Support data governance and security policies across cloud and on-premise systems. Produce clear documentation and communicate technical concepts in a user-friendly manner. Contribute to team best practices, standards, and process improvements. Required Qualifications 5#10 years of experience in data engineering or related fields. Strong proficiency in SQL and experience with data transformation technologies (e.g., Azure Data Factory, Apache Spark, Glue). Experience building and maintaining ELT/ETL pipelines in cloud platforms (AWS, Azure, or GCP). Solid understanding of data modeling (dimensional modeling, star schema, normalization). Hands-on experience with modern data warehousing platforms such as Databricks, Snowflake, or Azure Synapse. Strong programming skills in Python or another modern scripting language. Experience working with CI/CD workflows; familiarity with tools like Databricks Asset Bundles (DABs) is a plus. Ability to translate business requirements into technical specifications and data solutions. Excellent communication and documentation skills. Experience building Power BI data models or developing analytical datasets is preferred. Soft Skills Strong analytical and problem-solving skills with a proactive mindset. Ability to work independently and collaborate effectively within cross-functional teams. Comfortable participating in technical conversations and contributing ideas. High attention to detail, ownership, and accountability in delivering high-quality solutions.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on pediatricassociates.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · WWC Europe 2026

1:04 min

Introduction to Bitcoin script parsing tools

Steve Shadders · LIVE

2:46 min

Transforming data architecture from on-premise to cloud

Sandhya Menon Sandhya Menon · WWC Europe 2026

1:53 min

Evaluating traditional scripting languages for modern development tasks

Jens Knipper Jens Knipper · Europe 2026 Virtual

Videos

See all

Related articles

See all