Databricks Architect

Centraprise LLC
Ocean Ridge, FL, United States
4 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Unity 3d Data Analysis Big Data Data Architecture Information Engineering Extract Transform Load (ETL) Data Warehousing Apache Hive Query Optimization Apache Spark Event Driven Architecture Data Lakes
+3 more
Pyspark Data Management Databricks

Requirements

  • 10+ years of experience in Data Engineering and Data Architecture. \n

  • 5+ years of hands-on experience with Databricks, PySpark, and Apache Spark. \n

  • Strong expertise in - Databricks Lakehouse Architecture, Delta Lake, Unity Catalog, Delta Live Tables (DLT), Databricks Workflows, Medallion Architecture \n

  • Experience designing enterprise-scale analytics and data platforms. \n

  • Expert-level proficiency in PySpark and Spark SQL. \n

  • Advanced SQL development and query optimization skills. \n

  • Strong understanding of batch and streaming architectures. \n

  • Experience with data warehousing, ETL/ELT, and large-scale data processing. \n

  • Expertise in dimensional, relational, and analytical data modeling.

Benefits & conditions

  • Experience implementing data governance, data quality, and metadata management solutions. \n

  • Knowledge of CI/CD practices, Git, DevOps, and Infrastructure as Code (Terraform preferred). \n

  • Experience establishing architectural standards and engineering best practices. \n

\n

Roles & Responsibilities

\n \n

  • Architect and design scalable, secure, and high-performance data platforms using Databricks and AWS. \n

  • Lead solution design, data modeling, and enterprise data architecture initiatives. \n

  • Design and optimize batch and real-time data pipelines using Databricks, PySpark, and Delta Lake. \n

  • Partner with business and technology stakeholders to define requirements and deliver strategic data solutions. \n

  • Establish standards for data governance, security, quality, performance, and operational excellence. \n

  • Provide technical leadership, mentoring, and architectural guidance to engineering teams. \n

  • Drive cloud modernization, platform optimization, and data transformation initiatives. \n

\n

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…