Snowflake DBT Developer with Heavy Databricks-Location

Cyber Sphere LLC
Houston, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Houston, United States of America

Tech stack

Query Performance
Agile Methodologies
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Automation of Tests
Azure
Business Intelligence
Big Data
Cloud Computing
Cloud Engineering
Cluster Analysis
Code Review
Computer Programming
Continuous Integration
Data Architecture
Information Engineering
ETL
Data Mart
Data Sharing
Data Systems
Data Warehousing
DevOps
Github
Hive
JSON
Python
Meta-Data Management
Performance Tuning
Scrum
Query Optimization
Role-Based Access Control
Shell Script
SQL Databases
XML
Parquet
Google Cloud Platform
Macros
Data Ingestion
Azure
Sql Optimization
Snowflake
Spark
Change Data Capture
GIT
Data Lake
PySpark
Semi-structured Data
Git Flow
Data Lineage
Avro
Data Management
Terraform
Data Pipelines
Jenkins
Databricks

Job description

We are seeking a highly skilled Snowflake DBT Developer with extensive hands-on experience in Databricks to design, develop, and optimize modern cloud-based data platforms. The ideal candidate will have strong expertise in building scalable ELT pipelines using dbt, implementing data transformations in Snowflake, and leveraging Databricks (PySpark & Spark SQL) for large-scale data processing., This role requires a strong understanding of data warehousing, cloud-native architectures, performance optimization, and CI/CD best practices. The candidate will work closely with Data Architects, Data Engineers, BI Developers, and Business stakeholders to build reliable, scalable, and high-performance data solutions. Modern data engineering roles increasingly combine Snowflake, dbt, Databricks, SQL, cloud platforms, Git, CI/CD, and data quality practices., * Design, develop, and maintain enterprise-grade ELT pipelines using dbt and Snowflake.

  • Build scalable data ingestion and transformation frameworks using Databricks, PySpark, and Spark SQL.

  • Develop dimensional models, star schemas, and data marts for analytics and reporting.

  • Optimize Snowflake objects including:

  • Virtual Warehouses

  • Tables

  • Materialized Views

  • Streams & Tasks

  • Clustering Keys

  • Query Performance

Build reusable dbt models, macros, snapshots, tests, and documentation.

Develop incremental models and implement CDC (Change Data Capture) patterns.

Process structured and semi-structured data (JSON, Avro, Parquet, XML).

Implement Delta Lake architecture and optimize Spark workloads.

Collaborate with business users to translate requirements into scalable data solutions.

Implement data quality validation, automated testing, and monitoring.

Optimize pipeline performance, cloud costs, and warehouse utilization.

Build CI/CD pipelines for dbt deployments using Git-based workflows.

Troubleshoot production issues and perform root cause analysis.

Ensure compliance with security, governance, and data privacy standards.

Participate in Agile ceremonies including sprint planning, code reviews, and release activities., * Strong hands-on experience with Databricks

  • PySpark
  • Spark SQL
  • Delta Lake
  • Delta Live Tables
  • Unity Catalog
  • Auto Loader
  • Spark Optimization
  • Job Clusters
  • Workflow Scheduling
  • Performance Tuning

dbt

  • Advanced dbt Core
  • dbt Cloud
  • Incremental Models
  • Snapshots
  • Macros
  • Seeds
  • Tests
  • Documentation
  • Packages
  • Source Freshness
  • Exposures

Programming

  • Advanced SQL
  • Python
  • PySpark
  • Spark SQL
  • Shell Scripting

Data Engineering

  • Data Warehousing
  • Data Modeling
  • ELT
  • ETL
  • CDC
  • Slowly Changing Dimensions (SCD)
  • Data Lake
  • Lakehouse Architecture
  • Metadata Management
  • Data Lineage

Cloud Platforms

  • AWS / Azure / Google Cloud Platform
  • Object Storage (S3, ADLS, GCS)

Orchestration

  • Apache Airflow
  • Azure Data Factory
  • Databricks Workflows

DevOps

  • Git
  • Azure DevOps
  • GitHub Actions
  • Jenkins
  • CI/CD
  • Terraform (Preferred)

Requirements

Snowflake

  • 5+ years of hands-on Snowflake experience
  • Snowflake SQL
  • Data Sharing
  • Streams & Tasks
  • Time Travel
  • Zero Copy Cloning
  • Snowpipe
  • Secure Views
  • RBAC
  • Query Optimization
  • Performance Tuning
  • Warehouse Management
  • Cost Optimization

Apply for this position