Senior Databricks Engineer

WilsonCTS
Charlotte, NC, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$120,000.0 - $140,000.0
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Business Analytics Applications Cloud Computing Collaborative Software Information Systems Computer Programming Databases Information Engineering Data Governance
+20 more
Relational Databases Distributed Systems Python (Programming Language) PostgreSQL Oracle (Applications) Performance Tuning Systems Development Life Cycle Standard Sql Data Ingestion Apache Spark Data Strategy Amazon Relational Database Service Data Lakes Information Technology Atlassian Tools Data Management Functional Programming Data Pipelines Serverless Computing Databricks

Job description

We are seeking a highly skilled Senior Databricks Engineer to join our client’s innovative data engineering team in Charlotte, NC. This is a hands-on senior leader responsible for both technical delivery and people management. This role combines ownership of the Databricks-based enterprise data platform with direct management of a database engineering team, ensuring alignment between traditional database platforms and modern cloud-based data engineering solutions., * Provide technical leadership for Databricks-based data engineering and analytics solutions across multiple departments

  • Lead the design and implementation of enterprise data pipelines using Databricks, Spark, and cloud-native services
  • Own and drive cross-functional data initiatives from requirements through delivery and operationalization
  • Partner with product, architecture, and business teams to define enterprise data strategy, roadmaps, and delivery plans
  • Establish best practices for data modeling, performance optimization, cost management, security, and platform governance
  • Ensure alignment between Databricks data pipelines and core database platforms supporting HFA IT
  • Drive automation-first mindset for data ingestion, testing, deployment, and monitoring
  • Evaluate emerging data technologies and provide recommendations for enterprise adoption
  • Line manage the database engineering team, including performance management, coaching, and career development
  • Set clear objectives and expectations for team members aligned to departmental and enterprise goals
  • Build a high-performing, collaborative team culture focused on quality, ownership, and continuous improvement
  • Provide technical guidance, design reviews, and mentoring to engineers across database and data engineering disciplines
  • Support workforce planning, hiring, onboarding, and skills development for the team
  • Act as an escalation point for operational and delivery issues related to databases and data platforms
  • Own delivery outcomes for assigned data initiatives, ensuring timelines, quality, and operational readiness
  • Support the full SDLC (design, development, testing, deployment) for data and database solutions
  • Ensure compliance with enterprise standards, audit requirements, and regulatory expectations
  • Collaborate with global teams and third-party vendors where applicable

Requirements

  • Bachelor’s degree in Computer Science, Information Systems, or equivalent practical experience
  • 8-10 years of total IT experience with strong focus on data engineering, databases, and platform development
  • Proven experience managing technical teams in an enterprise environment
  • Demonstrated ability to balance hands-on technical contribution with people leadership responsibilities
  • Strong hands-on experience with Databricks (Spark, Delta Lake, notebooks, workflows)
  • Solid background in database technologies (PostgreSQL/Oracle or similar enterprise RDBMS)
  • Experience designing and operating large-scale data pipelines and distributed systems
  • Strong programming skills in Python; strong SQL required
  • Cloud experience (AWS preferred), including S3, EC2, RDS, Lambda, and orchestration services
  • Experience with CI/CD pipelines, automation, monitoring, and production support for data platforms
  • Knowledge of Agile and SDLC methodologies
  • Familiarity with collaboration tools such as JIRA and Confluence

Nice to Have

  • Financial services or fund accounting experience
  • Experience with data governance, security, and regulatory controls
  • Cloud or Databricks-related certifications

Benefits & conditions

Pay: $120,000.00 - $140,000.00 per year

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann +3 · LIVE

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all