Databricks Solution Architect (Data & AI)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+17 more
Job description
- Design end to end Lakehouse architectures on Databricks (Azure, AWS, or GCP), covering ingestion, medallion modeling, serving, governance, and cost control
- Lead discovery and architecture workshops with client executives and engineering teams, and present proposed solutions and roadmaps clearly
- Partner with sales and the Databricks field team on pursuits: shape solutions, answer RFPs, build proposals, estimate effort, and run POCs
- Define target architectures and migration paths from other solutions to Databricks
- Architect governance with Unity Catalog, including access control, lineage, data sharing, and compliance with client security requirements
- Design AI solutions, including RAG, agentic workflows, Model Serving, Vector Search, and MLflow based LLMOps and MLOps
- Guide delivery teams through build and go live, and review, audit, and improve existing designs and system architectures
- Run performance tuning, optimization, and FinOps reviews for Spark and Databricks SQL workloads
Requirements
- 8+ years of experience in data engineering, data architecture, or software development, including 3+ years designing solutions on Databricks
- Hands-on proficiency in Python and SQL; Scala is a plus
- Deep knowledge of Apache Spark, Delta Lake, Lakeflow (Spark Declarative Pipelines and Jobs), Databricks SQL, and Unity Catalog
- Experience with at least one major cloud (Azure, AWS, or GCP) and its data services, networking, and security model
- Proven experience leading large, client driven implementation projects, including pre-sales and proposal work
- Experience with streaming and messaging tools such as Kafka, Event Hubs, Kinesis, or Flink
- Knowledge of design patterns, CI/CD, infrastructure as code (Terraform), and Databricks Asset Bundles
- Working knowledge of AI on Databricks (Mosaic AI, Agent Bricks, MLflow)
- Strong communication and consulting skills, with fluent English (B2+ or higher)
- Authorization to work in the US or Canada
Nice to have
- Databricks Solution Architect Champion certification (a big plus), plus certifications such as Data Engineer Professional, Generative AI Engineer Associate, or Machine Learning Professional
Benefits & conditions
- Medical, Dental and Vision Insurance (Subsidized)
- Health Savings Account
- Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
- Short-Term and Long-Term Disability (Company Provided)
- Life and AD&D Insurance (Company Provided)
- Employee Assistance Program
- Unlimited access to LinkedIn learning solutions
- Matched 401(k) Retirement Savings Plan
- Paid Time Off - the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)
- Paid Holidays - nine (9) total per year
- Legal Plan and Identity Theft Protection
- Accident Insurance
- Employee Discounts
- Pet Insurance
- Employee Stock Purchase Program
- If otherwise eligible, participation in the discretionary annual bonus program
- If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program
About the company
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture, and you will collaborate with multinational teams on innovative projects while continuing to learn and grow., EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our clients, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.Engineer the Future with a Career at EPAM (https://www.youtube.com/embed/NU_mnNITn2o?si=IiCxyQ4sr1YJWxDG), EPAM will not provide new H-1B visa sponsorship for this position. Candidates with existing transferable H-1B status may be considered.
It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.
EPAM Systems, Inc. is an equal opportunity employer. We recognize the value of diversity and inclusion in creating success for our customers, business partners, shareholders, employees and communities. We are committed to recruiting, hiring, developing and promoting employees without discrimination. As a global employer, this commitment includes complying with all laws in the countries in which we operate. Nevertheless, we believe equal employment practices should not be limited to what the law requires. Equal opportunity and inclusion are essential to motivate, empower and recognize the best in everyone.
At EPAM, employment actions are based on individual qualifications, without regard to race, color, religion, creed, gender, pregnancy status, sexual orientation, gender identity, gender expression, marital or familial status, national origin, ancestry, genetics, age, disability status, veteran status, citizenship status when otherwise legally able to work, or any other characteristic protected by law.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦