> Markdown version of [/jobs/ext/2193814-principal-engineer-data-platforms](https://www.wearedevelopers.com/jobs/ext/2193814-principal-engineer-data-platforms). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Engineer, Data Platforms - **Company:** CVS Health - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $144,200.0 - $288,400.0 - **Contract:** Permanent contract - **Skills:** Unity 3d, Artificial Intelligence, Amazon Web Services, Computing Platforms, Microsoft Azure, Big Data, Cloud Engineering, Cyber Security, Continuous Integration, Data Architecture, Data Governance, Data Security, Distributed Systems, Github, Information Lifecycle Management, Automation of Marketing, Metadata, Meta-Data Management, Cloud Services, Security Information and Event Management, Data Streaming, Enterprise Data Management, Policy as Code, Google Cloud, Cloud Platform System, Apache Spark, Multi-Cloud, Data Lakes, Infrastructure Automation Frameworks, Apache Kafka, Apache Nifi, Data Management, Terraform, Splunk, Serverless Computing, Databricks - **Published:** August 23, 2026 - **Apply:** https://www.dice.com/job-detail/33c13770-110e-4bf0-a047-de969d442452 ## About the Role * 10+ years of experience architecting, building, and operating enterprise-scale cloud data platforms, data lakes, distributed systems, and large-scale data ingestion ecosystems supporting mission-critical workloads. * 8+ years of experience designing and administering Databricks platforms, including Apache Spark, Delta Lake, Unity Catalog, secure data access patterns, metadata management, lineage, and enterprise governance frameworks. * 8+ years of experience implementing Infrastructure-as-Code, platform automation, CI/CD pipelines, and Policy-as-Code controls using technologies such as Terraform, GitHub Actions, or comparable cloud-native automation platforms. * 7+ years of experience designing and operating high-scale streaming and telemetry ingestion architectures processing more than 100 TB per day using technologies such as Kafka, Event Hub, Kinesis, Pub/Sub, NiFi, Cribl, or similar platforms. * 5+ years of experience serving as a Principal Engineer, Lead Architect, or equivalent technical leadership role driving enterprise platform strategy, multi-cloud architecture across Azure, AWS, and Google Cloud Platform, engineering standards, security governance, and large-scale transformation initiatives resulting in measurable improvements in scalability, reliability, operational efficiency, governance maturity, and platform adoption., * Extensive experience building and evolving enterprise-scale data platforms, analytics ecosystems, observability platforms, or cloud-native engineering platforms within large and highly regulated environments. * Hands-on expertise with Unity Catalog, Delta Sharing, metadata services, lineage frameworks, information stewardship, retention controls, and federated operating models. * Proven success driving Splunk rationalization efforts, security analytics modernization, SIEM ecosystems, telemetry consolidation, or monitoring transformation programs. * Strong background designing secure serverless computing environments, multi-tenant architectures, workload isolation strategies, and Databricks deployments spanning Azure, AWS, and Google Cloud Platform. * Demonstrated success establishing FinOps disciplines, consumption governance, chargeback methodologies, provisioning automation, and resource optimization programs that improve efficiency and operational simplicity. * Databricks certifications (Data Engineer, Data Architect, Platform Architect, or equivalent) coupled with knowledge of AI/ML enablement, advanced analytical workloads, OpenTelemetry (OTEL), and Open Cybersecurity Schema Framework (OCSF) standards., Bachelor's degree from accredited university or equivalent work experience (HS diploma + 4 years relevant experience). ## Description We are seeking a Principal Engineer, Data Platforms to serve as the senior technical authority responsible for the architecture, engineering, governance, and evolution of the Unified Ingestion Platform and Federated Data Lake supporting enterprise observability, security, and operational telemetry data. The Principal Engineer, Data Platforms will define and execute the technology strategy for a highly scalable, cloud-native data platform capable of ingesting and processing hundreds of terabytes of data daily across Azure, AWS, and Google Cloud Platform. The Principal Engineer, Data Platforms will own the enterprise Databricks platform strategy and architecture, including multi-cloud account structures, workspace design, infrastructure automation, security controls, governance frameworks, data lifecycle management, metadata services, and platform standardization. The Principal Engineer, Data Platforms will lead a multi-year transformation initiative focused on consolidating fragmented observability, security, and operational telemetry platforms into a unified, governed, and cost-efficient ecosystem leveraging Databricks, Delta Lake, Unity Catalog, and modern cloud-native engineering practices. As the organization's foremost technical expert in enterprise data platforms, the Principal Engineer, Data Platforms will establish engineering standards, drive infrastructure-as-code and policy-as-code adoption, lead enterprise-wide architecture decisions, and influence strategic technology investments. The Principal Engineer, Data Platforms will partner with engineering, security, operations, infrastructure, and business stakeholders to deliver a resilient, scalable, secure, and future-ready data platform that improves operational intelligence, strengthens governance, accelerates onboarding, enables AI/ML and analytics workloads, and promotes consistent multi-cloud platform operations across the enterprise. PRIMARY RESPONSIBILITIES Platform Architecture & Engineering Leadership * Define and own the architecture, strategy, and multi-year roadmap for the Unified Ingestion Platform and Federated Data Lake supporting observability, security, and operational telemetry data across the enterprise. * Architect and scale high-volume ingestion and processing capabilities supporting 250+ TB per day across logs, metrics, traces, security events, and operational datasets while driving platform modernization and convergence initiatives. * Establish and govern enterprise Databricks architecture, including multi-cloud account structures, workspace strategies, environment isolation, metadata management, data governance, lineage, and secure access models. * Lead implementation of Infrastructure-as-Code, Policy-as-Code, automated provisioning, and enterprise-grade CI/CD pipelines to enable reliable, standardized, and scalable platform operations. * Define enterprise security, governance, observability, reliability, and operational excellence practices while aligning platform standards with OpenTelemetry (OTEL), Open Cybersecurity Schema Framework (OCSF), and enterprise compliance requirements. Technical Leadership, Optimization & Innovation * Serve as the highest-level technical escalation point and provide architectural leadership across engineering, security, infrastructure, and platform teams. * Establish FinOps strategies, cost allocation frameworks, resource optimization practices, and capacity planning models to ensure efficient and cost-effective platform operations. * Mentor engineers and architects while driving adoption of cloud-native engineering principles, automation frameworks, governance standards, and platform best practices. * Evaluate emerging technologies and develop strategic roadmaps that improve platform scalability, reliability, governance, developer productivity, and operational efficiency. * Enable advanced analytics, security analytics, observability intelligence, and AI/ML workloads through trusted, governed, and reusable enterprise data platform capabilities. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!](https://www.wearedevelopers.com/videos/1204-coding-an-immersive-copilot-using-unity-net-and-azure-openai) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)