Principal Engineer, Data Platforms (Architecture & Ingestion)

CVS Health
United States
14 days ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Compensation
$144,200.0 - $288,400.0
Working hours
Regular working hours
Job source

Tech stack

Unity 3d Artificial Intelligence Amazon Web Services Computing Platforms Microsoft Azure Information Lifecycle Management Metadata Cloud Services Enterprise Data Management Policy as Code Google Cloud Multi-Cloud
+5 more
Data Lakes Infrastructure Automation Frameworks Apache Nifi Data Management Databricks

Job description

We are seeking a Principal Engineer, Data Platforms to serve as the senior technical authority responsible for the architecture, engineering, governance, and evolution of the Unified Ingestion Platform and Federated Data Lake supporting enterprise observability, security, and operational telemetry data. The Principal Engineer, Data Platforms will define and execute the technology strategy for a highly scalable, cloud-native data platform capable of ingesting and processing hundreds of terabytes of data daily across Azure, AWS, and GCP.

The Principal Engineer, Data Platforms will own the enterprise Databricks platform strategy and architecture, including multi-cloud account structures, workspace design, infrastructure automation, security controls, governance frameworks, data lifecycle management, metadata services, and platform standardization. The Principal Engineer, Data Platforms will lead a multi-year transformation initiative focused on consolidating fragmented observability, security, and operational telemetry platforms into a unified, governed, and cost-efficient ecosystem leveraging Databricks, Delta Lake, Unity Catalog, and modern cloud-native engineering practices.

As the organization’s foremost technical expert in enterprise data platforms, the Principal Engineer, Data Platforms will establish engineering standards, drive infrastructure-as-code and policy-as-code adoption, lead enterprise-wide architecture decisions, and influence strategic technology investments. The Principal Engineer, Data Platforms will partner with engineering, security, operations, infrastructure, and business stakeholders to deliver a resilient, scalable, secure, and future-ready data platform that improves operational intelligence, strengthens governance, accelerates onboarding, enables AI/ML and analytics workloads, and promotes consistent multi-cloud platform operations across the enterprise.

PRIMARY RESPONSIBILITIES

Platform Architecture & Engineering Leadership

  • Defineandownthearchitecture,strategy,andmulti-yearroadmapfortheUnifiedIngestionPlatformandFederatedDataLakesupportingobservability,security,andoperationaltelemetrydataacrosstheenterprise.
  • Architectandscalehigh-volumeingestionandprocessingcapabilitiessupporting250+TBperdayacrosslogs,metrics,traces,securityevents,andoperationaldatasetswhiledrivingplatformmodernizationandconvergenceinitiatives.
  • EstablishandgovernenterpriseDatabricksarchitecture,includingmulti-cloudaccountstructures,workspacestrategies,environmentisolation,metadatamanagement,datagovernance,lineage,andsecureaccessmodels.
  • LeadimplementationofInfrastructure-as-Code,Policy-as-Code,automatedprovisioning,andenterprise-gradeCI/CDpipelinestoenablereliable,standardized,andscalableplatformoperations.
  • Defineenterprisesecurity,governance,observability,reliability,andoperationalexcellencepracticeswhilealigningplatformstandardswithOpenTelemetry(OTEL),OpenCybersecuritySchemaFramework(OCSF),andenterprisecompliancerequirements.

Technical Leadership, Optimization & Innovation

  • Serveasthehighest-leveltechnicalescalationpointandprovidearchitecturalleadershipacrossengineering,security,infrastructure,andplatformteams.
  • EstablishFinOpsstrategies,costallocationframeworks,resourceoptimizationpractices,andcapacityplanningmodelstoensureefficientandcost-effectiveplatformoperations.
  • Mentorengineersandarchitectswhiledrivingadoptionofcloud-nativeengineeringprinciples,automationframeworks,governancestandards,andplatformbestpractices.
  • Evaluateemergingtechnologiesanddevelopstrategicroadmapsthatimproveplatformscalability,reliability,governance,developerproductivity,andoperationalefficiency.
  • Enableadvancedanalytics,securityanalytics,observabilityintelligence,andAI/MLworkloadsthroughtrusted,governed,andreusableenterprisedataplatformcapabilities.

Requirements

  • 10+yearsofexperiencearchitecting,building,andoperatingenterprise-scaleclouddataplatforms,datalakes,distributedsystems,andlarge-scaledataingestionecosystemssupportingmission-criticalworkloads.
  • 8+yearsofexperiencedesigningandadministeringDatabricksplatforms,includingApacheSpark,DeltaLake,UnityCatalog,securedataaccesspatterns,metadatamanagement,lineage,andenterprisegovernanceframeworks.
  • 8+yearsofexperienceimplementingInfrastructure-as-Code,platformautomation,CI/CDpipelines,andPolicy-as-CodecontrolsusingtechnologiessuchasTerraform,GitHubActions,orcomparablecloud-nativeautomationplatforms.
  • 7+yearsofexperiencedesigningandoperatinghigh-scalestreamingandtelemetryingestionarchitecturesprocessingmorethan100TBperdayusingtechnologiessuchasKafka,EventHub,Kinesis,Pub/Sub,NiFi,Cribl,orsimilarplatforms.
  • 5+yearsofexperience serving as a Principal Engineer, Lead Architect, or equivalent technical leadership role driving enterprise platform strategy,multi-cloudarchitectureacrossAzure,AWS,andGCP,engineeringstandards,securitygovernance,andlarge-scaletransformationinitiativesresultinginmeasurableimprovementsinscalability,reliability,operationalefficiency,governancematurity,andplatformadoption., * Extensive experiencebuildingandevolvingenterprise-scaledataplatforms,analyticsecosystems,observabilityplatforms,orcloud-nativeengineeringplatformswithinlargeandhighlyregulatedenvironments.
  • Hands-onexpertisewithUnityCatalog,DeltaSharing,metadataservices,lineageframeworks,informationstewardship,retentioncontrols,andfederatedoperatingmodels.
  • ProvensuccessdrivingSplunkrationalizationefforts,securityanalyticsmodernization,SIEMecosystems,telemetryconsolidation,ormonitoringtransformationprograms.
  • Strongbackgrounddesigningsecureserverlesscomputingenvironments,multi-tenantarchitectures,workloadisolationstrategies,andDatabricksdeploymentsspanningAzure,AWS,andGCP.
  • DemonstratedsuccessestablishingFinOpsdisciplines,consumptiongovernance,chargebackmethodologies,provisioningautomation,andresourceoptimizationprogramsthatimproveefficiencyandoperationalsimplicity.
  • Databricks certifications (DataEngineer,DataArchitect,PlatformArchitect,orequivalent)coupledwithknowledgeofAI/MLenablement,advancedanalyticalworkloads,OpenTelemetry(OTEL),andOpenCybersecuritySchemaFramework(OCSF)standards., Bachelor’s degree from accredited university or equivalent work experience (HS diploma + 4 years relevant experience).

Benefits & conditions

discriminate in recruiting, hiring, promotion, or any other personnel action based on race, ethnicity, color, national origin, sex/gender, sexual orientation, gender identity or expression, religion, age, disability, protected veteran status, or any other characteristic protected by applicable federal, state, or local law. We proudly support and encourage people with military experience (active, veterans, reservists and National Guard) as well as military spouses to apply for CVS Health job opportunities.

Pay Range

The typical pay range for this role is:

$144,200.00 - $288,400.00

This pay range represents the base hourly rate or base annual full-time salary for all positions in the job grade within which this position falls. The actual base salary offer will depend on a variety of factors including experience, education, geography and other relevant factors. This position is eligible for a CVS Health bonus, commission or short-term incentive program in addition to the base pay range listed above. This position also includes an award target in the company’s equity award program.

Our people fuel our future. Our teams reflect the customers, patients, members and communities we serve and we are committed to fostering a workplace where every colleague feels valued and that they belong.

Great benefits for great people

We take pride in offering a comprehensive and competitive mix of pay and benefits that reflects our commitment to our colleagues and their families.

This full-time position is eligible for a comprehensive benefits package designed to support the physical, emotional, and financial well-being of colleagues and their families. The benefits for this position include medical, dental, and vision coverage, paid time off, retirement savings options, wellness programs, and other resources, based on eligibility.

About the company

Bring your heart to CVS Health Every one of us at CVS Health shares a single, clear purpose: Bringing our heart to every moment of your health. This purpose guides our commitment to deliver enhanced human-centric health care for a rapidly changing world. Anchored in our brand - with heart at its center - our purpose sends a personal message that how we deliver our services is just as important as what we deliver. Our Heart At Work Behaviors support this purpose. We want everyone who works at CVS Health to feel empowered by the role they play in transforming our culture and accelerating our ability to innovate and deliver solutions to make health care more personal, convenient and affordable. We strive to promote and sustain a culture of diversity, inclusion and belonging every day. CVS Health is an affirmative action employer, and is an equal opportunity employer, as are the physician-owned businesses for which CVS Health provides management services. We do not

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:36 min

Development tools for spatial computing and drones

Zaid Zaim Zaid Zaim · World Congress 2023

1:47 min

Comparing Egeria to alternative open metadata solutions

Ferd Scheepers · World Congress 2022

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:30 min

Technical trade-offs between game engines and headsets

Zaid Zaim Zaid Zaim · World Congress 2023

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

Videos

See all

Related articles

See all