Sr. Data Engineer - Databricks / SQL / ADF

Keypixel Software Solutions

Eden Prairie, MN, United States

about 1 month ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Query Performance Microsoft Azure Information Engineering Extract Transform Load (ETL) Data Transformation Data Warehousing Dimensional Modeling Microsoft SQL Server SQL Azure Standard Sql SQL Databases Transact-SQL

+4 more

Apache Spark Pyspark Data Analytics Databricks

Job description

Develop and maintain data pipelines using Databricks, Apache Spark, and SQL
Design and implement ETL/ELT processes for data transformation and loading
Work closely with stakeholders to understand data requirements and deliver solutions
Optimize query performance and ensure data quality and integrity
Collaborate with cross-functional teams to support data analytics and reporting
Stay current on industry trends and best practices in data engineering

Requirements

We are seeking a highly skilled Senior Data Engineer with expertise in Databricks, SQL, and ADF to join our team in Eden Prairie, MN. The ideal candidate will have 12+ years of experience in data engineering and a strong background in data warehousing and optimization., * Experience with SQL Server, Azure SQL, and advanced T-SQL

Proficiency in Databricks, Apache Spark, PySpark, and ADF
Knowledge of data warehousing concepts and dimensional modeling
Hands-on experience with SCD (Slowly Changing Dimensions) and ETL/ELT processes
Familiarity with Azure Cloud services
Ability to tune queries and optimize performance

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Prepare application

Good distractions

Loading talks and stories from around this role…