Azure Data Bricks Solution Architect

Diverse Lynx LLC
Tampa, United States of America
7 days ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 110K

Job location

Tampa, United States of America

Tech stack

Amazon Web Services (AWS)
Azure
Continuous Integration
Information Engineering
Data Governance
ETL
Data Systems
Data Warehousing
DevOps
Distributed Computing Environment
Python
Netsuite
Power BI
DataOps
SQL Databases
Systems Architecture
Unstructured Data
Data Processing
Cloud Platform System
Azure
Spark
Data Lake
Machine Learning Operations
Data Pipelines
Databricks

Job description

  • Lead the architectural design and deployment of comprehensive data solutions on the Databricks platform.
  • Develop and enhance scalable data pipelines processing both structured and unstructured data using Apache Spark within Databricks.
  • Establish and maintain best practices for data engineering and system architecture.
  • Collaborate closely with data scientists, analysts, and business stakeholders to gather requirements and convert them into scalable, effective solutions.
  • Design and oversee the development of CI/CD pipelines and automation workflows for Databricks projects.
  • Ensure all solutions meet data governance, security, and compliance standards.
  • Provide technical guidance and mentorship to the data engineering team.
  • Assess and integrate new tools and technologies to improve platform performance and efficiency.
  • Work with cloud environments such as Azure, AWS, or GCP integrated with Databricks., Job Description: Title: Solution Architect Location: Tampa, FL (Hybrid - 3 days onsite) Responsibilities: Identify new platform capabilities in coordination with multiple …
  • 1 month ago, This is a senior, high-visibility NetSuite ownership role sitting at the intersection of IT and Finance. You will own the architecture, configuration, and strategic direction of th…
  • 2 months ago
  • Apply easily

Requirements

  • Minimum 8 years of hands-on experience with Databricks technologies, including Apache Spark, Delta Lake, MLflow, and DBSQL.
  • Extensive experience building large-scale ETL/ELT data pipelines.
  • Strong proficiency in data modeling, data warehousing concepts, and distributed computing frameworks.
  • Experience working with cloud platforms-preferably Azure, but AWS or GCP is also acceptable.
  • Demonstrated ability to implement and enforce data engineering best practices and architectural standards.
  • Skilled in Python, SQL, and Spark-based data processing.
  • Solid understanding of DevOps methodologies related to Databricks, including CI/CD and infrastructure as code.

Preferred Qualifications

  • Knowledge of BI tools such as Power BI or Synapse Analytics.
  • Certifications like Databricks Certified Data Engineer or Microsoft Certified: Azure Solutions Architect are advantageous .

Apply for this position