Data Engineer SQL Spark PySpark ADF Databricks

Tech Inc

Irving, TX, United States

12 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

10 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Data Analysis Microsoft Azure Big Data Cloud Computing Cloud Database Code Review Databases Information Engineering Data Infrastructure Data Integrity Extract Transform Load (ETL) Data Transformation

+19 more

Data Systems Data Warehousing Database Development Database Security Dimensional Modeling Apache Hive Microsoft SQL Server SQL Azure Performance Tuning Query Optimization SQL Stored Procedures SQL Databases Transact-SQL Database Optimization Apache Spark Data Lakes Pyspark Data Pipelines Databricks

Job description

We are seeking a highly skilled Senior Database Developer with deep expertise in SQL Server and Azure SQL and hands-on experience with Databricks to design, develop, optimize, and maintain scalable data solutions. The ideal candidate will play a key role in building performant data models, supporting analytics and reporting needs, and collaborating with data engineers, analysts, and application teams in a cloud-based environment., * Design, develop, and maintain complex SQL Server and Azure SQL databases.

Write and optimize advanced T-SQL queries, stored procedures, functions, and views.
Perform query tuning, indexing strategies, and performance optimization for large-scale datasets.
Implement best practices for database security, data integrity, and reliability. Cloud & Data Platform
Develop and manage data solutions in Azure SQL Database.
Work with Databricks (Apache Spark) to support data transformations, analytics, and large-scale data processing.
Integrate Azure SQL with Databricks using Delta Lake, Spark SQL, and PySpark/SQL where applicable.
Support cloud-based data architectures and hybrid data environments. Data Modeling & Warehousing
Design and maintain relational and dimensional data models.
Implement Slowly Changing Dimensions (SCD) and other data warehousing patterns.
Support ETL/ELT processes and collaborate with data engineering teams. Collaboration & Leadership
Partner with application developers, data engineers, BI teams, and stakeholders to understand data requirements.
Provide guidance and mentoring to junior developers.
Participate in code reviews and enforce database development standards.
Troubleshoot production issues and provide root cause analysis. ______

Requirements

10+ years of experience as a Database Developer or similar role.
Strong expertise in SQL Server and Azure SQL.
Advanced proficiency in T-SQL, including performance tuning and query optimization.
Hands-on experience with Databricks and Apache Spark.
Solid understanding of data warehousing concepts, dimensional modeling, and SCD.
Experience working in Azure cloud environments.
Strong analytical, problem-solving, and communication skills. “ Skills Data Engineering, SQL, Spark, PySpark, ADF, Databricks