Azure Data Bricks Solution Architect

Diverse Lynx LLC

Tampa, FL, United States

about 1 month ago

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Compensation

$104,000.0 - $110,240.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Amazon Web Services Microsoft Azure Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Systems Data Warehousing DevOps Distributed Computing Environment Python (Programming Language) Netsuite

+13 more

Power BI DataOps SQL Databases Systems Architecture Unstructured Data Data Processing Cloud Platform System Azure Data Factory Apache Spark Data Lakes Machine Learning Operations Data Pipelines Databricks

Job description

Lead the architectural design and deployment of comprehensive data solutions on the Databricks platform.
Develop and enhance scalable data pipelines processing both structured and unstructured data using Apache Spark within Databricks.
Establish and maintain best practices for data engineering and system architecture.
Collaborate closely with data scientists, analysts, and business stakeholders to gather requirements and convert them into scalable, effective solutions.
Design and oversee the development of CI/CD pipelines and automation workflows for Databricks projects.
Ensure all solutions meet data governance, security, and compliance standards.
Provide technical guidance and mentorship to the data engineering team.
Assess and integrate new tools and technologies to improve platform performance and efficiency.
Work with cloud environments such as Azure, AWS, or GCP integrated with Databricks., Job Description: Title: Solution Architect Location: Tampa, FL (Hybrid - 3 days onsite) Responsibilities: Identify new platform capabilities in coordination with multiple …
1 month ago, This is a senior, high-visibility NetSuite ownership role sitting at the intersection of IT and Finance. You will own the architecture, configuration, and strategic direction of th…
2 months ago
Apply easily

Requirements

Minimum 8 years of hands-on experience with Databricks technologies, including Apache Spark, Delta Lake, MLflow, and DBSQL.
Extensive experience building large-scale ETL/ELT data pipelines.
Strong proficiency in data modeling, data warehousing concepts, and distributed computing frameworks.
Experience working with cloud platforms-preferably Azure, but AWS or GCP is also acceptable.
Demonstrated ability to implement and enforce data engineering best practices and architectural standards.
Skilled in Python, SQL, and Spark-based data processing.
Solid understanding of DevOps methodologies related to Databricks, including CI/CD and infrastructure as code.

Preferred Qualifications

Knowledge of BI tools such as Power BI or Synapse Analytics.
Certifications like Databricks Certified Data Engineer or Microsoft Certified: Azure Solutions Architect are advantageous .