> Markdown version of [/jobs/ext/2179998-principal-engineer-data-platforms-architecture-ingestion](https://www.wearedevelopers.com/jobs/ext/2179998-principal-engineer-data-platforms-architecture-ingestion). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Engineer, Data Platforms (Architecture & Ingestion) - **Company:** CVS Health - **Location:** United States (Remote available) - **Experience:** Experienced - **Salary:** $144,200.0 - $288,400.0 - **Contract:** Permanent contract - **Skills:** Unity 3d, Artificial Intelligence, Amazon Web Services, Computing Platforms, Microsoft Azure, Information Lifecycle Management, Metadata, Cloud Services, Enterprise Data Management, Policy as Code, Google Cloud, Multi-Cloud, Data Lakes, Infrastructure Automation Frameworks, Apache Nifi, Data Management, Databricks - **Published:** August 22, 2026 - **Apply:** https://dejobs.org/x/x/ED27A35FDFBE4E868C6CE13ADC7F01AD/job/ ## About the Role * 10+yearsofexperiencearchitecting,building,andoperatingenterprise-scaleclouddataplatforms,datalakes,distributedsystems,andlarge-scaledataingestionecosystemssupportingmission-criticalworkloads. * 8+yearsofexperiencedesigningandadministeringDatabricksplatforms,includingApacheSpark,DeltaLake,UnityCatalog,securedataaccesspatterns,metadatamanagement,lineage,andenterprisegovernanceframeworks. * 8+yearsofexperienceimplementingInfrastructure-as-Code,platformautomation,CI/CDpipelines,andPolicy-as-CodecontrolsusingtechnologiessuchasTerraform,GitHubActions,orcomparablecloud-nativeautomationplatforms. * 7+yearsofexperiencedesigningandoperatinghigh-scalestreamingandtelemetryingestionarchitecturesprocessingmorethan100TBperdayusingtechnologiessuchasKafka,EventHub,Kinesis,Pub/Sub,NiFi,Cribl,orsimilarplatforms. * 5+yearsofexperience serving as a Principal Engineer, Lead Architect, or equivalent technical leadership role driving enterprise platform strategy,multi-cloudarchitectureacrossAzure,AWS,andGCP,engineeringstandards,securitygovernance,andlarge-scaletransformationinitiativesresultinginmeasurableimprovementsinscalability,reliability,operationalefficiency,governancematurity,andplatformadoption., * Extensive experiencebuildingandevolvingenterprise-scaledataplatforms,analyticsecosystems,observabilityplatforms,orcloud-nativeengineeringplatformswithinlargeandhighlyregulatedenvironments. * Hands-onexpertisewithUnityCatalog,DeltaSharing,metadataservices,lineageframeworks,informationstewardship,retentioncontrols,andfederatedoperatingmodels. * ProvensuccessdrivingSplunkrationalizationefforts,securityanalyticsmodernization,SIEMecosystems,telemetryconsolidation,ormonitoringtransformationprograms. * Strongbackgrounddesigningsecureserverlesscomputingenvironments,multi-tenantarchitectures,workloadisolationstrategies,andDatabricksdeploymentsspanningAzure,AWS,andGCP. * DemonstratedsuccessestablishingFinOpsdisciplines,consumptiongovernance,chargebackmethodologies,provisioningautomation,andresourceoptimizationprogramsthatimproveefficiencyandoperationalsimplicity. * Databricks certifications (DataEngineer,DataArchitect,PlatformArchitect,orequivalent)coupledwithknowledgeofAI/MLenablement,advancedanalyticalworkloads,OpenTelemetry(OTEL),andOpenCybersecuritySchemaFramework(OCSF)standards., Bachelor's degree from accredited university or equivalent work experience (HS diploma + 4 years relevant experience). ## Description We are seeking a Principal Engineer, Data Platforms to serve as the senior technical authority responsible for the architecture, engineering, governance, and evolution of the Unified Ingestion Platform and Federated Data Lake supporting enterprise observability, security, and operational telemetry data. The Principal Engineer, Data Platforms will define and execute the technology strategy for a highly scalable, cloud-native data platform capable of ingesting and processing hundreds of terabytes of data daily across Azure, AWS, and GCP. The Principal Engineer, Data Platforms will own the enterprise Databricks platform strategy and architecture, including multi-cloud account structures, workspace design, infrastructure automation, security controls, governance frameworks, data lifecycle management, metadata services, and platform standardization. The Principal Engineer, Data Platforms will lead a multi-year transformation initiative focused on consolidating fragmented observability, security, and operational telemetry platforms into a unified, governed, and cost-efficient ecosystem leveraging Databricks, Delta Lake, Unity Catalog, and modern cloud-native engineering practices. As the organization's foremost technical expert in enterprise data platforms, the Principal Engineer, Data Platforms will establish engineering standards, drive infrastructure-as-code and policy-as-code adoption, lead enterprise-wide architecture decisions, and influence strategic technology investments. The Principal Engineer, Data Platforms will partner with engineering, security, operations, infrastructure, and business stakeholders to deliver a resilient, scalable, secure, and future-ready data platform that improves operational intelligence, strengthens governance, accelerates onboarding, enables AI/ML and analytics workloads, and promotes consistent multi-cloud platform operations across the enterprise. PRIMARY RESPONSIBILITIES Platform Architecture & Engineering Leadership * Defineandownthearchitecture,strategy,andmulti-yearroadmapfortheUnifiedIngestionPlatformandFederatedDataLakesupportingobservability,security,andoperationaltelemetrydataacrosstheenterprise. * Architectandscalehigh-volumeingestionandprocessingcapabilitiessupporting250+TBperdayacrosslogs,metrics,traces,securityevents,andoperationaldatasetswhiledrivingplatformmodernizationandconvergenceinitiatives. * EstablishandgovernenterpriseDatabricksarchitecture,includingmulti-cloudaccountstructures,workspacestrategies,environmentisolation,metadatamanagement,datagovernance,lineage,andsecureaccessmodels. * LeadimplementationofInfrastructure-as-Code,Policy-as-Code,automatedprovisioning,andenterprise-gradeCI/CDpipelinestoenablereliable,standardized,andscalableplatformoperations. * Defineenterprisesecurity,governance,observability,reliability,andoperationalexcellencepracticeswhilealigningplatformstandardswithOpenTelemetry(OTEL),OpenCybersecuritySchemaFramework(OCSF),andenterprisecompliancerequirements. Technical Leadership, Optimization & Innovation * Serveasthehighest-leveltechnicalescalationpointandprovidearchitecturalleadershipacrossengineering,security,infrastructure,andplatformteams. * EstablishFinOpsstrategies,costallocationframeworks,resourceoptimizationpractices,andcapacityplanningmodelstoensureefficientandcost-effectiveplatformoperations. * Mentorengineersandarchitectswhiledrivingadoptionofcloud-nativeengineeringprinciples,automationframeworks,governancestandards,andplatformbestpractices. * Evaluateemergingtechnologiesanddevelopstrategicroadmapsthatimproveplatformscalability,reliability,governance,developerproductivity,andoperationalefficiency. * Enableadvancedanalytics,securityanalytics,observabilityintelligence,andAI/MLworkloadsthroughtrusted,governed,andreusableenterprisedataplatformcapabilities. ## Related Videos - [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai) - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!](https://www.wearedevelopers.com/videos/1204-coding-an-immersive-copilot-using-unity-net-and-azure-openai) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)