Databricks Resident Solution Architect

Smart It Staffing, Inc.
United States
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Data Analysis Microsoft Azure Big Data Data Architecture Information Engineering Data Governance Python (Programming Language) Enterprise Data Management Cloud Platform System Apache Spark
+8 more
Data Lakes Pyspark Infrastructure Automation Frameworks Data Management Machine Learning Operations Terraform Data Pipelines Databricks

Job description

Marlabs, a global AI and Digital Solutions Consulting firm, delivers intelligent solutions across AI, data, analytics, and product engineering. Since 2000, we have partnered with some of the largest healthcare, life sciences, financial services, and government organizations worldwide. As we continue to expand our global footprint, we have an exciting opportunity for a highly skilled Databricks Resident Solution Architect to join our innovative and dynamic team. **Databricks Resident Solution Architect | About You ** As a Databricks Resident Solution Architect, you are a senior, hands-on architect responsible for designing, guiding, and operationalizing modern cloud data platforms built on the Databricks Lakehouse. You bring deep expertise in Databricks, Spark, and large-scale data engineering, and you are comfortable operating within complex, regulated enterprise environments. You thrive in resident architect engagements, working closely with client stakeholders to establish strong architectural foundations, governance standards, and long-term platform strategies. You excel at translating business objectives into secure, scalable technical designs and guiding teams through platform adoption, analytics enablement, and AI readiness. You are confident in acting as a technical authority while collaborating effectively across business and engineering teams. **Databricks Resident Solution Architect | Day-to-Day **

  • Architect and guide implementation of Databricks-based data platforms, leveraging Lakehouse and Medallion architecture best practices.
  • Provide hands-on technical leadership across data engineering, analytics, and AI-enabled use cases using Databricks.
  • Define and enforce data governance, security, and access control standards using Databricks Unity Catalog and enterprise data management principles.
  • Enable and support AI/ML workloads, including ML pipelines and model lifecycle integration within the Databricks ecosystem.
  • Optimize platform performance, scalability, and cost efficiency with a FinOps-oriented mindset.
  • Collaborate closely with business leaders, architects, and engineering teams to align platform capabilities with enterprise data and analytics needs.
  • Serve as a resident technical authority, providing architectural guidance, mentoring teams, and ensuring solution quality and consistency.

Requirements

  • 10+ years of overall experience in data engineering, data architecture, or analytics engineering roles.
  • 5+ years of hands-on experience with Databricks, including Delta Lake, Unity Catalog, Workflows/Jobs, and Lakehouse architecture.
  • Databricks Professional Certification (MANDATORY).
  • Strong expertise in Apache Spark (PySpark preferred), Python, and advanced SQL.
  • Proven experience designing and implementing production-grade, large-scale data pipelines.
  • Hands-on experience with at least one major cloud platform (Azure preferred, AWS or GCP acceptable).
  • Experience with data modeling, Medallion architecture, and enterprise data platform design.
  • Familiarity with CI/CD pipelines, infrastructure automation tools (e.g., Terraform), and Agile delivery practices.
  • Strong communication and stakeholder-facing skills, with experience operating in regulated enterprise environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.wayup.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

Videos

See all

Related articles

See all