Lead Databricks Administrator

Epsilon, Inc.
Westminster, United States of America
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 182K

Job location

Westminster, United States of America

Tech stack

API
Amazon Web Services (AWS)
Azure
Unix
Cloud Computing
Configuration Management
System Configuration
Continuous Integration
Data Governance
Data Infrastructure
Data Security
Database Design
Database Marketing
Identity and Access Management
Python
Performance Tuning
Systems Development Life Cycle
Role-Based Access Control
Standard Sql
Runbook
SQL Databases
Data Processing
Scripting (Bash/Python/Go/Ruby)
Google Cloud Platform
Cloud Platform System
Infrastructure Automation Frameworks
Information Technology
Terraform
Data Pipelines
Databricks

Job description

For this role, we are seeking a Lead Databricks Administrator with a balance of skills in database design, physical implementation, and performance tuning. You will be part of a team that supports cloud Data Lake environments implemented on AWS, Azure and GCP for some of Epsilon's most prominent Database Marketing clients., * Lead Databricks platform administration across enterprise workspaces, accounts, and cloud environments

  • Define and enforce standards for workspace provisioning, resource naming, access controls, compute configuration, and operational governance
  • Drive consistent administration practices across Databricks environments to reduce risk, improve supportability, and support long-term platform growth
  • Partner with Product, Engineering, Security, Cloud, and Operations teams to align Databricks platform setup with enterprise security and compliance expectations
  • Oversee workspace setup, cluster configuration, SQL Warehouse administration, job execution standards, and platform lifecycle management
  • Support governance and access control processes, including least privilege access, group management, service principal usage, and admin access reviews
  • Lead automation efforts for repeatable provisioning, configuration management, reporting, and operational controls
  • Monitor platform health, usage, performance, and cost trends; identify opportunities for optimization and improvement
  • Troubleshoot complex issues across Databricks, cloud infrastructure, identity, networking, data access, and workload execution
  • Evaluate new Databricks capabilities and recommend adoption where they improve governance, scalability, security, or operational efficiency
  • Maintain platform documentation, standards, runbooks, and operational procedures
  • Mentor administrators and engineers, promote best practices, and help improve the maturity of Databricks platform operations
  • Support production operations, incident response, and on-call rotation as needed

Requirements

  • Able to lead platform administration efforts across complex, enterprise-scale Databricks environments
  • Strong ownership mindset with the ability to drive standards, governance, and operational improvements from planning through execution
  • Operationally disciplined, with a strong focus on platform stability, audit readiness, production support, and repeatable processes
  • Comfortable working across Product, Engineering, Security, Cloud, and Operations teams to align on secure and scalable platform practices
  • Focused on building consistent administration practices that improve reliability, reduce risk, and support long-term platform growth
  • Proactive in identifying gaps in access controls, provisioning, platform configuration, monitoring, cost visibility, and operational readiness
  • Strong attention to detail, especially around workspace configuration, identity integration, group management, permissions, and admin access controls
  • Able to balance business delivery needs with enterprise security, compliance, cost, and supportability requirements
  • Strong problem solver who can work through complex issues across Databricks, cloud infrastructure, identity, networking, data access, and workload execution
  • Comfortable operating in production environments where platform decisions impact client delivery, data processing, performance, and availability
  • Clear communicator who can explain technical risks, standards, and remediation plans to both technical teams and leadership
  • Leads by example, mentors others, shares best practices, and helps raise the overall level of platform administration discipline

What you'll bring:

  • BS in Computer Science or related technical discipline, or equivalent practical experience
  • 7+ years of experience in database administration, data platform administration, cloud infrastructure, or related technology roles
  • 3+ years of hands-on experience administering Databricks workspaces, accounts, clusters, jobs, SQL Warehouses, and related platform services
  • Strong understanding of Databricks workspace management, account administration, compute configuration, access controls, platform governance, and operational best practices
  • Experience supporting Databricks environments across one or more major cloud platforms such as AWS, Azure, or GCP
  • Hands-on experience with identity and access management concepts, including SSO, SCIM provisioning, RBAC, service principals, groups, and least privilege access models
  • Working knowledge of Unity Catalog, data governance, secure data access patterns, catalog-level permissions, and data access auditing
  • Experience implementing and enforcing platform standards such as workspace naming, group naming, resource naming, admin access controls, provisioning workflows, and configuration baselines
  • Experience maintaining platform hygiene, including workspace reviews, admin access reviews, group cleanup, unused resource identification, and standards compliance
  • Experience with infrastructure automation and configuration management using Terraform, scripting, APIs, CI/CD pipelines, or similar tools
  • Ability to monitor, troubleshoot, and optimize Databricks workloads for performance, reliability, scalability, and cost efficiency
  • Strong understanding of Databricks compute patterns, cluster policies, job execution behavior, SQL Warehouse usage, and workload isolation practices
  • Ability to diagnose issues across Databricks, cloud infrastructure, networking, identity, storage access, permissions, and data pipeline execution
  • Strong SQL, Unix/Linux, and scripting skills
  • Python or Scala experience is a plus
  • Experience in creating and maintaining operational documentation, runbooks, standards, procedures, and support guides
  • Experience working with vendor support, internal engineering teams, and security teams to resolve issues within expected timelines
  • Strong understanding of change management, SDLC practices, incident response, release coordination, and production support expectations
  • Ability to work independently with minimal supervision while managing multiple priorities across client and platform initiatives
  • Excellent written and verbal communication skills

Benefits & conditions

Pulled from the full job description

  • Tuition reimbursement
  • Parental leave
  • 401(k)
  • Health insurance
  • Paid time off
  • Vision insurance
  • Dental insurance, As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to the following:
  • Time to Recharge: Flexible time off (FTO), 15 paid holidays
  • Time to Recover: Paid sick time
  • Family Well-Being: Parental/new child leave, childcare & elder care assistance, adoption assistance
  • Extra Perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Epsilon benefits are subject to eligibility requirements and other terms., Compensation Range: USD $98,000.00 - USD $182,000.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met. Temporary roles may also qualify for participation in our 401(k) plan after eligibility criteria have been met. For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off. The Company anticipates the application deadline for this job posting will be 7/28/2026.

About the company

A subsidiary of Publicis Groupe, Epsilon is a leading provider of multi-channel marketing services, technologies, and database solutions. We do more than collect and store data, and we might be the most important Internet company you've never heard of. Join our team for your chance to work in the digital marketing space and solve meaningful problems on a massive scale-and have fun doing it., Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we've provided marketers from the world's leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels. Epsilon's comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world. Our pillars aren't just words. They're how we show up every day. * People centricity: We focus on employee well-being in an environment where colleagues truly care about each other. * Collaboration: We work together, support one another, and collectively achieve goals. * Growth: There are endless opportunities for growth through learning, development and career advancement. * Innovation: We drive progress through cutting-edge solutions and forward-thinking approaches. * Flexibility: We've created a balance between work and personal life, and we encourage adaptability to solve problems creatively. Our values guide us to create value for our clients, our people and consumers. * Act with integrity * Work together to win together * Innovate with purpose * Respect all voices * Empower with accountability These pillars and values are our foundation-shaping our culture, guiding our decisions, and uniting us in common purpose.

Apply for this position