> Markdown version of [/jobs/ext/3559404-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/3559404-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Data Engineer - **Company:** Genesis10 - **Location:** Eagan, MN, United States - **Experience:** Expert - **Salary:** $197,600.0 - $218,400.0 - **Contract:** Temporary to permanent - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Automation of Tests, Cloud Computing, Continuous Integration, Data Architecture, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Systems, Data Warehousing, Distributed Computing Environment, Identity and Access Management, Data Intelligence, Interoperability, SQL Databases, Data Ingestion, Fast Healthcare Interoperability Resources, Apache Spark, Git, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Real Time Data, Apache Kafka, Machine Learning Operations, Cloudwatch, Amazon Simple Queue Service (SQS), Terraform, Data Pipelines, Serverless Computing, Databricks - **Published:** October 2, 2026 - **Apply:** https://www.dice.com/job-detail/6ea9edf9-f2f1-4f0a-9d9d-9b71e208589b ## About the Role * 5-8+ years of experience in data engineering, platform engineering, data architecture, or related areas * 3-5+ years of hands-on Databricks experience in production environments * Strong hands-on experience with AWS cloud technologies, including services such as S3, Lambda, Glue, SQS, IAM, CloudWatch, and related services * Advanced experience with SQL, Spark, PySpark, and distributed data processing * Strong knowledge of the Databricks Lakehouse Platform, including: + Delta Lake + Medallion Architecture + Unity Catalog + Databricks SQL + Workflows + Notebooks * Experience designing and developing enterprise-scale ETL/ELT pipelines and data integration solutions * Strong understanding of data modeling, data quality, governance, and enterprise data architecture * Experience optimizing Spark and SQL workloads for performance and scalability * Experience with Terraform or other infrastructure-as-code technologies * Experience with Git-based development and CI/CD practices * Ability to independently solve complex technical problems while collaborating across engineering and architecture teams * Strong communication skills with the ability to explain technical concepts to both technical and business stakeholders Desired Skills: * Experience with advanced Databricks capabilities such as Delta Live Tables, Asset Bundles, Serverless Compute, Lakehouse Federation, or Data Intelligence * Experience leading or contributing to enterprise Databricks migrations or modernization initiatives * Experience with streaming or real-time data technologies such as Kafka, MSK, or Kinesis * Experience with AI/ML workloads within Databricks * Databricks Professional or Solutions Architect certification * AWS Solutions Architect or Data Engineer certification * Healthcare or health insurance industry experience * Familiarity with healthcare interoperability standards such as FHIR ## Description We are seeking a highly experienced Data Engineer with deep hands-on expertise in Databricks and AWS to help design, build, and evolve enterprise-scale data solutions. This individual will work across data engineering, platform engineering, and architecture to develop scalable data pipelines, establish modern engineering patterns, and support the continued adoption of Databricks across the organization. The role can be aligned at the Senior or Principal level based on experience, with opportunities for a more senior candidate to provide broader technical leadership, influence architecture, and help establish enterprise Databricks standards., * Design, develop, and maintain scalable enterprise data solutions using Databricks, Spark, SQL, and AWS * Build and optimize data ingestion, transformation, orchestration, and integration pipelines * Develop reusable frameworks and engineering components that improve scalability, maintainability, and adoption across teams * Design solutions using modern Databricks capabilities, including Delta Lake, Medallion Architecture, Unity Catalog, Databricks Workflows, and Databricks SQL * Partner with architects, engineers, product owners, and business teams to translate requirements into scalable technical solutions * Participate in architecture and solution-design discussions and provide technical recommendations * Support modernization efforts involving migration from legacy ETL and data warehouse technologies to Databricks * Establish and promote best practices around data quality, performance, security, governance, observability, and cost optimization * Troubleshoot complex production and performance issues and implement sustainable solutions * Build and support production-grade engineering practices, including automated testing, CI/CD, and infrastructure as code * Mentor other engineers and contribute to technical standards, documentation, and engineering best practices * For more senior candidates, provide technical leadership across Databricks architecture, platform adoption, modernization, and enterprise engineering standards ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)