Senior Data Platform Engineer job in Salisbury

Ahold Delhaize Usa
Salisbury, NC, United States
4 days ago
Apply on jobs.diversity.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$125,040.0 - $187,560.0
Working hours
Regular working hours

Tech stack

Unity 3d Application Programming Interfaces (APIs) Artificial Intelligence Audit Trail Microsoft Azure Bash Shell Cloud Computing Configuration Management Code Review Cyber Security Continuous Integration Information Engineering
+38 more
Data Infrastructure DevOps Domain Name System (DNS) Github Monitoring of Systems Identity and Access Management Subnetting Python (Programming Language) Key Management Network Security Log Analysis Routing OAuth Performance Tuning Windows PowerShell Role-Based Access Control Azure Active Directory Azure Data Lake Software Vulnerability Management Enterprise Data Management Datadog Computer Networking Systems Cloud Platform System Azure Data Factory Cloud Monitoring System Availability Firewalls (Computer Science) Git Data Lakes Deployment Automation Bicep Machine Learning Operations Cloud Optimization Terraform Devsecops Serverless Computing Key Vault Databricks

Job description

The Software Engineer III (Senior Data Platform Engineer) is responsible for designing, engineering, automating, securing, and supporting enterprise data platforms built on Microsoft Azure and Azure Databricks. The engineer will drive platform modernization, security, reliability, automation, observability, and cost optimization across Azure and Databricks environments. The position requires strong technical leadership and collaboration with Data Engineering, Cloud Operations, Architecture, Cybersecurity, and other technology teams to deliver scalable, secure and highly available platforms., * Design, deploy, configure, and support Azure infrastructure and data-platform services, including Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage Gen2 (ADLS), Azure Key Vault, managed identities and related Azure services.

  • Engineer and troubleshoot Azure networking, including VNets, subnets, NSGs, Private Link/private endpoints, DNS, routing, firewalls, Network Security Perimeters (NSP), and secure connectivity between Databricks, storage, applications and enterprise networks.
  • Administer and deploy Azure Databricks environments, including workspace configuration, compute, serverless capabilities, Unity Catalog, storage integration, identity and access management, workspace security, policies and platform troubleshooting.
  • Develop reusable Infrastructure as Code (IaC) using Terraform and/or Azure Bicep to automate provisioning and configuration of Azure infrastructure, Databricks workspaces, networking, storage, security controls and supporting platform services.
  • Implement DevSecOps and CI/CD practices using GitHub, GitHub Actions and/or Azure DevOps, including automated infrastructure deployment, configuration management, testing, security controls and environment promotion.
  • Implement and maintain security and governance controls across Azure and Databricks, including Microsoft Entra ID, RBAC, managed identities, service principals, OAuth, Azure Key Vault, Unity Catalog, secrets management, access controls and audit logging.
  • Support Databricks/ Unity Catalog capabilities including metastore, catalogs, schemas, workspace bindings, external locations, storage credentials, permissions, and secure access patterns while partnering with data-domain owners responsible for data products and data-access groups.
  • Establish monitoring and observability across Azure and Databricks using Azure Monitor, Log Analytics, Databricks system tables and audit logs, Datadog and related technologies, with proactive alerting and operational dashboards.
  • Drive platform reliability through incident management, root-cause analysis, vulnerability remediation, patching/upgrades, capacity management, high availability, BCDR, performance optimization and automation of operational activities.Identify and implement FinOps and cost-optimization opportunities across Azure and Databricks, including infrastructure utilization, compute sizing, serverless workloads, storage lifecycle management, stale-resource remediation, tagging and cost attribution.
  • Provide technical leadership through IaC/code reviews, platform standards, technical documentation, mentoring, troubleshooting and collaboration with engineering teams and managed-service partners.

Requirements

  • 7+ years of experience in cloud, infrastructure, DevOps, or platform engineering, with strong hands-on experience designing and supporting enterprise Microsoft Azure environments and meaningful hands-on experience with Azure Databricks platform engineering / administration.
  • Strong knowledge of Azure infrastructure and networking, including VNets, NSGs, private endpoints, Private Link, DNS, routing, Entra ID, RBAC, managed identities, Key Vault, ADLS Gen2 and ADF.
  • Hands-on knowledge of Azure Databricks, including workspace administration, Unity Catalog, compute, storage integration, identity and access management, networking, security, monitoring and troubleshooting.
  • Demonstrated experience with Terraform and/or Azure Bicep, Git-based development, CI/CD pipelines, DevSecOps practices, and automation using PowerShell, Python, Bash or similar technologies.
  • Experience operating enterprise platforms with an understanding of security, governance, observability, reliability, incident management, BCDR, performance optimization and cloud cost management.
  • Strong communication and problem-solving skills.

Preferred Qualifications

  • Microsoft Azure and/or Databricks professional certifications.
  • Experience managing multiple Azure Databricks workspaces and implementing enterprise standards for workspace provisioning, Unity Catalog, security, governance, networking, and platform administration.
  • Advanced experience with Terraform, Azure Bicep, Databricks Terraform Provider, GitHub Actions, Azure DevOps, Databricks CLI/APIs, and automated deployment patterns.
  • Experience with Databricks capabilities such as Databricks SQL, Delta Lake, Lakeflow, Asset Bundles, serverless compute, AI/BI, Genie, MLflow, or Mosaic AI.
  • Experience implementing enterprise observability using Datadog, Azure Monitor, Log Analytics, Databricks system tables, and audit logs.

About the company

Ahold Delhaize USA, a division of global food retailer Ahold Delhaize, is part of the U.S. family of brands, which includes five leading omnichannel grocery brands - Food Lion, Giant Food, The GIANT Company, Hannaford and Stop & Shop. Our associates support the brands with a wide range of services, including Finance, Legal, Sustainability, Commercial, Digital and E-commerce, Technology and more., At Ahold Delhaize USA, we provide services to one of the largest portfolios of grocery companies in the nation, and we’re actively seeking top talent.

Our team shares a common motivation to drive change, take ownership and enable our brands to better care for their customers. We thrive on supporting great local grocery brands and their strategies.

Our associates are the heartbeat of our organization. We are committed to offering a welcoming work environment where all associates can succeed and thrive. Guided by our values of courage, care, teamwork, integrity (and even a little humor), we are dedicated to being a great place to work.

We believe in collaboration, curiosity, and continuous learning in all that we think, create and do. While building a culture where personal and professional growth are just as important as business growth, we invest in our people, empowering them to learn, grow and deliver at all levels of the business.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.diversity.com
Prepare application

Good distractions

Loading talks and stories from around this role…