Principal Data Engineer

Genesis10
Eagan, MN, United States
about 1 month ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$198,848.0 - $219,648.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Amazon S3 Microsoft Azure Big Data Cloud Database Code Review Continuous Integration Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Systems
+25 more
Software Design Patterns Distributed Computing Environment Apache Hive Identity and Access Management Interoperability Python (Programming Language) Machine Learning Cloud Services DataOps SQL Databases Google Cloud Fast Healthcare Interoperability Resources Apache Spark State Machines HybridCloud Gitlab Pyspark Apache Kafka Data Management Video Streaming Cloudwatch Amazon Simple Queue Service (SQS) Terraform Data Pipelines Databricks

Job description

As the Principal Data Engineer, you will serve as the most senior technical contributor on the Data Platform Engineering team. This role is responsible for providing technical leadership, influencing architecture and engineering standards, and designing scalable data solutions that support analytics, automation, and future AI initiatives. You will partner with architects and engineering teams to design modern cloud-based data platforms and solve complex technical challenges in a hands-on capacity., * Provide technical leadership and architectural guidance for enterprise data engineering initiatives

  • Establish engineering standards, design patterns, and best practices across the data engineering organization
  • Mentor and coach data engineers through technical guidance, design reviews, and code reviews
  • Design, develop, and implement scalable cloud-based data engineering solutions
  • Build and optimize data pipelines supporting ingestion, transformation, orchestration, and delivery
  • Partner with Product Owners and business stakeholders to translate business requirements into scalable technical solutions
  • Serve as the technical escalation point for complex production issues and data engineering challenges
  • Drive continuous improvement of engineering processes, tooling, and development standards

Requirements

  • 8+ years of professional data engineering experience designing and delivering enterprise-scale data solutions
  • Healthcare or health insurance industry experience
  • Expert-level Python and SQL with extensive experience building scalable ETL/ELT pipelines
  • Strong cloud data engineering experience using AWS or equivalent enterprise cloud platforms (Azure or Google Cloud Platform)
  • Experience processing large datasets using Spark, PySpark, Spark SQL, or similar distributed processing technologies
  • Proven ability to design end-to-end data engineering solutions including ingestion, transformation, orchestration, automation, and data quality
  • Strong understanding of cloud-native data architectures and modern data engineering best practices
  • Demonstrated experience influencing technical direction, architecture decisions, and engineering standards
  • Experience mentoring engineers and leading technical discussions across teams
  • Excellent communication skills with both technical and non-technical stakeholders
  • Ability to work independently while driving complex technical initiatives

Desired Skills:

  • Hands-on Databricks experience including notebooks, workflows, and cluster management
  • Experience with AWS services including S3, Lambda, Glue, Step Functions, SQS, IAM, and CloudWatch
  • Experience with AI-enabled data platforms, automation, or machine learning data pipelines
  • Infrastructure-as-Code experience using Terraform
  • CI/CD pipeline experience using GitLab or similar tools
  • Experience with streaming technologies such as Kafka, MSK, or Kinesis
  • FHIR or healthcare interoperability experience
  • AWS Solutions Architect or Data Engineer Certification

About the company

Genesis10 is currently seeking a Principal Data Engineer - Hybrid position with a Regional Health Insurance Provider located in Eagan, MN. This is a 6+ month contract-to-hire opportunity., Ranked a Top Staffing Firm in the U.S. by Staffing Industry Analysts for six consecutive years, Genesis10 puts thousands of consultants and employees to work across the United States every year in contract, contract-for-hire, and permanent placement roles. With more than 300 active clients, Genesis10 provides access to many of the Fortune 100 firms and a variety of mid-market organizations across the full spectrum of industry verticals.

For contract roles, Genesis10 offers the benefits listed below. If this is a perm-placement opportunity, our recruiter can talk you through the unique benefits offered for that particular client. Benefits of Working with Genesis10:

  • Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years
  • The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years
  • Access to an experienced, caring recruiting team (more than 7 years of experience, on average)
  • Behavioral Health Platform
  • Medical, Dental, Vision
  • Health Savings Account
  • Voluntary Hospital Indemnity (Critical Illness & Accident), For multiple years running, Genesis10 has been recognized as a Top Staffing Firm in the U.S., as a Best Company for Work-Life Balance, as a Best Company for Career Growth, for Diversity, and for Leadership, amongst others. To learn more and to view all of our available career opportunities, please visit us at our website.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:14 min

Structuring CI/CD pipelines with integrated security and quality checks

Christoph Ruggenthaler · LIVE

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:29 min

Utilizing specific tooling for continuous integration and modeling

Christoph Fassbach Christoph Fassbach +1 · World Congress 2024

4:54 min

Implementing geographic salary tiers for compensation equity and fairness

Rudi Bauer Rudi Bauer +1 · Cappuccino with HR

Videos

See all

Related articles

See all