Senior Databricks Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+20 more
Job description
We are seeking a highly skilled Senior Databricks Engineer to join our client’s innovative data engineering team in Charlotte, NC. This is a hands-on senior leader responsible for both technical delivery and people management. This role combines ownership of the Databricks-based enterprise data platform with direct management of a database engineering team, ensuring alignment between traditional database platforms and modern cloud-based data engineering solutions., * Provide technical leadership for Databricks-based data engineering and analytics solutions across multiple departments
- Lead the design and implementation of enterprise data pipelines using Databricks, Spark, and cloud-native services
- Own and drive cross-functional data initiatives from requirements through delivery and operationalization
- Partner with product, architecture, and business teams to define enterprise data strategy, roadmaps, and delivery plans
- Establish best practices for data modeling, performance optimization, cost management, security, and platform governance
- Ensure alignment between Databricks data pipelines and core database platforms supporting HFA IT
- Drive automation-first mindset for data ingestion, testing, deployment, and monitoring
- Evaluate emerging data technologies and provide recommendations for enterprise adoption
- Line manage the database engineering team, including performance management, coaching, and career development
- Set clear objectives and expectations for team members aligned to departmental and enterprise goals
- Build a high-performing, collaborative team culture focused on quality, ownership, and continuous improvement
- Provide technical guidance, design reviews, and mentoring to engineers across database and data engineering disciplines
- Support workforce planning, hiring, onboarding, and skills development for the team
- Act as an escalation point for operational and delivery issues related to databases and data platforms
- Own delivery outcomes for assigned data initiatives, ensuring timelines, quality, and operational readiness
- Support the full SDLC (design, development, testing, deployment) for data and database solutions
- Ensure compliance with enterprise standards, audit requirements, and regulatory expectations
- Collaborate with global teams and third-party vendors where applicable
Requirements
- Bachelor’s degree in Computer Science, Information Systems, or equivalent practical experience
- 8-10 years of total IT experience with strong focus on data engineering, databases, and platform development
- Proven experience managing technical teams in an enterprise environment
- Demonstrated ability to balance hands-on technical contribution with people leadership responsibilities
- Strong hands-on experience with Databricks (Spark, Delta Lake, notebooks, workflows)
- Solid background in database technologies (PostgreSQL/Oracle or similar enterprise RDBMS)
- Experience designing and operating large-scale data pipelines and distributed systems
- Strong programming skills in Python; strong SQL required
- Cloud experience (AWS preferred), including S3, EC2, RDS, Lambda, and orchestration services
- Experience with CI/CD pipelines, automation, monitoring, and production support for data platforms
- Knowledge of Agile and SDLC methodologies
- Familiarity with collaboration tools such as JIRA and Confluence
Nice to Have
- Financial services or fund accounting experience
- Experience with data governance, security, and regulatory controls
- Cloud or Databricks-related certifications
Benefits & conditions
Pay: $120,000.00 - $140,000.00 per year
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Analyst Salary in the UK
Making Data Warehouses Fast: A Developer’s Story
Top Big Data Technologies That You Need to Know