Databricks Solution Architect

MK SOFTWARE SOLUTIONS INC

United States

1 day ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Unity 3d Amazon Web Services Amazon S3 Microsoft Azure Big Data Cloud Computing Continuous Integration Data Architecture Information Engineering Data Governance Extract Transform Load (ETL) DevOps

+16 more

Apache Hive Python (Programming Language) Scala (Programming Language) Software Engineering Google Cloud Azure Data Factory Sql Optimization Apache Spark Generative AI Data Lakes Pyspark Kubernetes Data Management Machine Learning Operations Docker Databricks

Requirements

8+ years of experience in data engineering, big data architecture, or software engineering with a focus on data platforms.
5+ years of deep, hands-on experience designing, implementing, and optimizing solutions on the Databricks platform.
Expert-level proficiency in Apache Spark ecosystem (PySpark, Spark SQL, Scala) and large-scale data processing.
Strong experience with cloud infrastructure (AWS, Azure, Google Cloud Platform), including storage solutions (S3, ADLS), networking, and security models.
Deep expertise in Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and best practices for ETL/ELT, data governance, and reliability.
Proficiency in Python, Scala, advanced SQL, and modern DevOps practices including Docker, Kubernetes, and CI/CD. Professional & Communication Skills:
Exceptional client-facing and presentation skills, able to communicate complex concepts to both technical and C-level audiences.
Proven leadership in client engagements, ability to drive consensus and influence decision-making across stakeholder groups.
Strong problem-solving, analytical skills, and a proactive, consultative mindset. Preferred Qualifications:
Databricks Certified Professional or higher certifications.
Relevant cloud certifications (e.g., AWS Certified Big Data, Azure Data Engineer, Google Professional Data Engineer).
Experience with MLOps, generative AI, and advanced analytics on Databricks.
Prior experience in senior consulting, solution architecture, or resident roles