Databricks Solution Architect

Siri InfoSolutions Inc

Irving, TX, United States

6 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

$102,675.0 - $171,125.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Artificial Intelligence Amazon Web Services Application Frameworks Information Engineering Data Infrastructure Data Systems Data Warehousing Distributed Systems Apache Hadoop Python (Programming Language) Machine Learning Performance Tuning

+10 more

Cloudera Enterprise Software Applications Large Language Models Generative AI Data Lakes Pyspark Machine Learning Operations Data Pipelines AWS EKS Databricks

Job description

We are looking for a highly skilled and passionate Databricks Solution Architect to design end-to-end data solutions, define architecture patterns, guide implementation teams, ensure integration with enterprise systems, and promote best practices in data engineering and machine learning workflows. Lead proof-of-concept developments and evaluate new platform features, and ensure that security and compliance standards are met, * Work closely with Data Scientists, Business Team and Engineers to understand business requirements, translating those requirements into technical architectures, and ensuring the effective integration of Databricks with other enterprise systems.

Recommend best practices around data engineering, machine learning, and analytics workflows, as well as guiding teams in the adoption of efficient architecture patterns.
Define project scope, set technical direction, and troubleshoot complex problems.
Lead the development of proof-of-concept solutions, evaluate new platform features, and ensure that security and compliance standards are met.
Plan and execute Migration strategies to transition on prem data warehouse and Datalake into cloud based Databricks
Develop reusable frameworks for Data Engineering and Machine Learning Data Pipelines
Explore AI and Gen AI solutions for business requirements and provide solutions to adopt them.

Requirements

Proven expertise in implementing Lakehouse and Delta Lake using Databricks.
Strong PySpark and Python experience
Databricks (AWS) Platform Architect Certification
Familiarity with ML Ops/LLM Ops and distributed systems.
Experience with Big Data platform like Cloudera Hadoop and Could platforms like AWS, GCP.
Solid understanding of system design patterns, scalability, observability, and performance tuning.
Strong analytical and problem-solving skills.
Passion for exploring and building with emerging technologies.

Good to Have Skills: AWS EKS Experience, Dockers and Containers

Benefits & conditions

$80,000-158,000 per year We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the we…
8 hours ago +