Senior Solution Architect- Spark & Databricks Expert

Koantek LLC
United States
3 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Big Data Cloud Computing Information Engineering Data Systems Software Debugging Distributed Data Store Performance Tuning SQL Databases Data Streaming Apache Spark Data Lakes Pyspark
+2 more
Data Analytics Databricks

Job description

  • Customer Leadership: Lead engagements from discovery to delivery with full ownership and accountability.
  • Architecture & Optimization: Architect, implement, and optimize large-scale Spark/Databricks workloads focusing on scalability and cost-efficiency.
  • Spark Expertise: Apply expert-level Spark fundamentals to troubleshoot and tune distributed data jobs and SQL workloads.
  • Proactive Delivery: Design and execute PoCs and workshops to demonstrate solution vision and inspire customer confidence.
  • Strategic Advocacy: Act as a technical advocate for customers, anticipating issues and applying creative, data-driven solutions.
  • Cross-functional Partnership: Collaborate with product and engineering teams to improve customer experience and platform features.
  • Mentorship: Champion best practices in PySpark, Databricks, and Lakehouse design while mentoring junior engineers.

Requirements

Consulting, Apache Spark, Technical Leadership, Problem Solving Skills, Technical Strategy, Leadership, Cross-Functional, Customer Experience, Product Engineering, Mentoring, We are seeking a Senior Data Solutions Consultant with deep expertise in Apache Spark and Databricks. This role requires a decisive, agentic-forward approach to problem-solving. You will independently lead complex customer engagements, bridging hands-on data engineering excellence with strategic technical leadership. As a trusted advisor, you will proactively build and implement solutions that unlock significant value for our customers., * Experience: 5-10 years in data engineering or analytics solution delivery.

  • Databricks Mastery: 3+ years of hands-on expertise, including job optimization, debugging, and workload governance.
  • Technical Depth: Deep understanding of Spark Internals, PySpark, and Databricks SQL (DBSQL) performance tuning.
  • Modern Lakehouse: Strong knowledge of Delta Lake, Structured Streaming, and cloud infrastructure.
  • Autonomy: Proven ability to identify and solve complex technical problems with minimal oversight.
  • Communication: Exceptional skills to simplify technical complexity for business leaders., * Certifications: Databricks Certified Data Engineer Professional.
  • Advanced Skills: Experience with Delta Live Tables (DLT) and Unity Catalog (UC).
  • Consulting Background: Experience in large-scale data migration or AI-assisted analytics in enterprise environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…