Staff Data Engineer Databricks

Bain & Co.
Boston, MA, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours

Tech stack

Agile Methodology Artificial Intelligence Data Analysis Automation of Tests Microsoft Azure Continuous Integration Information Engineering Data Governance Data Vault Modeling Data Warehousing DevOps Github
+16 more
Python (Programming Language) SQL Azure Performance Tuning Systems Development Life Cycle Power BI SQL Databases Data Streaming Tableau (Software) Working Model 2D Azure Data Factory Apache Spark Git Data Lakes Pyspark Data Analytics Databricks

Job description

You’ll join Bain’s internal Data and Analytics team, responsible for developing the internal data platform on Databricks that supports cross functional Analytics needs. You’ll collaborate with internal technology teams, architects, business stakeholders, and third-party development partners to design, build, and support scalable technology solutions with a global user base., * Define and drive the engineering roadmap for our Azure Databricks lakehouse, including pipelines, orchestration, and integrations with Bain’s internal systems

  • Lead architecture, design, and prototyping for new data products and major platform upgrades with Data and Systems Architects
  • Set engineering standards for Delta Lake, Unity Catalog, Databricks Workflows, CI/CD, testing, and documentation
  • Partner with business stakeholders to turn requirements into well-scoped solutions, with clear recommendations on scope, architecture, and effort
  • Own production reliability, including support, monitoring, and cost optimization
  • Evaluate emerging tools and technologies and recommend where we should invest

Leadership

  • Lead, coach, and develop a team of data engineers, including hiring, performance management, and career growth
  • Provide technical leadership to external vendor teams and hold them accountable for delivery quality
  • Communicate risks, progress, and trade-offs to technology leadership and steering committees
  • Promote Agile practices and a culture of knowledge sharing

Requirements

Business Strategy, Consulting, Functional Analysis, Cross-Functional, Alliance/Partner Marketing, Data Analysis, Technical Support, Scalable System Development, Technical Leadership, Microsoft Windows Azure, Required

  • 6+ years of data engineering experience, including 2+ years building production workloads on Databricks on any cloud
  • Expert SQL and Python, with strong PySpark and Spark performance tuning skills
  • Hands-on experience with Delta Lake, Unity Catalog, and Databricks Workflows
  • Experience designing lakehouse and data warehouse architectures on Azure (ADLS, Azure SQL, Azure Data Factory), with solid grounding in storage, networking, and identity
  • Strong data modeling skills (dimensional, data vault, or lakehouse patterns)
  • Experience working with complex Row level security (RLS)
  • DevOps experience: Git, GitHub Actions, and automated testing
  • Clear communication with technical and non-technical stakeholders across time zones

Preferred

  • Databricks certifications
  • Experience with data governance, classification, and access-control design in a confidential-data environment
  • Experience leading or coordinating vendor or offshore engineering teams
  • Experience with Delta Live Tables/Lakeflow, streaming, or FinOps on Databricks
  • Experience delivering data to Power BI or Tableau or Databricks AI/BI or Sigma

WORKING MODEL

This role follows a hybrid model, requiring in-office presence at least 1 day per week in the Boston, Chicago, or Atlanta office.

Benefits & conditions

Compensation for this role includes base salary, annual discretionary performance bonus, 401(k) plan with an annual employer contribution based on years of service and Bain’s best in class benefits package.

Some local governments in the United States require a good-faith, reasonable salary range to be included in job postings for open roles. The estimated annualized compensation for this role is as follows:

  • In Boston, MA, the good-faith, reasonable annualized full-time salary range for this role is between 155k and 186 k
  • In Chicago, IL, the good-faith, reasonable annualized full-time salary range for this role is between 148k and 178k
  • In Atlanta, GA, the good-faith, reasonable annualized full-time salary range for this role is between 135k and 162k

Placement within these ranges will vary based on several factors including, but not limited to experience, education, licensure/certifications, training, and skill level.

  • Annual discretionary performance bonus
  • This role may also be eligible for other elements of discretionary compensation
  • 4.5% 401(k) company contribution, which increases after 3 years of service and is 100% vested upon start date

Bain & Company’s comprehensive benefits and wellness program is designed to help employees achieve personal independence, protection and stability in the areas most important to you and your family.

  • Bain pays 100% individual employee premiums for medical, dental and vision programs, offering one of the most comprehensive medical plans for employees without impacting your paycheck
  • Generous paid time off, including parental leave, sick leave and paid holidays
  • Fully vested 401(k) company contribution
  • Paid Life and Long-Term Disability insurance
  • Annual fitness reimbursements

About the company

We are proud to be consistently recognized as one of the world’s best places to work. We are currently the top ranked consulting firm on Glassdoor’s Best Places to Work list and have earned the #1 overall spot a record seven times. Extraordinary teams are at the heart of our business strategy, but these don’t happen by chance. They require intentional focus on bringing together a broad set of backgrounds, cultures, experiences, perspectives, and skills in a supportive and inclusive work environment. We hire people with exceptional talent and create an environment in which every individual can thrive professionally and personally.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…