Data Engineer

Comprehensive Resources Inc.

Chicago, IL, United States

2 months ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

10 years minimum

Working hours

Regular working hours

Job source

dice.com

Tech stack

Data Analysis Microsoft Azure Big Data Cloud Computing Cloud Database Code Review Databases Information Engineering Data Infrastructure Data Integrity Extract Transform Load (ETL) Data Transformation

+19 more

Data Systems Data Warehousing Database Development Database Security Dimensional Modeling Apache Hive Microsoft SQL Server SQL Azure Performance Tuning Query Optimization SQL Stored Procedures SQL Databases Transact-SQL Enterprise Data Management Database Optimization Apache Spark Data Lakes Pyspark Databricks

Job description

Seeking a Senior Data Engineer with deep expertise in SQL Server, Azure SQL, and Databricks to design, optimize, and deliver scalable cloud-based data solutions supporting analytics and enterprise data platforms, * Database Development & Optimization: Design, develop, and maintain complex SQL Server and Azure SQL databases.

Write and optimize advanced T-SQL queries, stored procedures, functions, and views.
Perform query tuning, indexing strategies, and performance optimization for large-scale datasets.
Implement best practices for database security, data integrity, and reliability.
Cloud & Data Platform: Develop and manage data solutions in Azure SQL Database.
Work with Databricks (Apache Spark) to support data transformations, analytics, and large-scale data processing.
Integrate Azure SQL with Databricks using Delta Lake, Spark SQL, and PySpark/SQL where applicable.
Support cloud-based data architectures and hybrid data environments.
Data Modelling & Warehousing: Design and maintain relational and dimensional data models.
Implement Slowly Changing Dimensions (SCD) and other data warehousing patterns.
Support ETL/ELT processes and collaborate with data engineering teams.
Collaboration & Leadership: Partner with application developers, data engineers, BI teams, and stakeholders to understand data requirements.
Provide guidance and mentoring to junior developers.
Participate in code reviews and enforce database development standards.
Troubleshoot production issues and provide root cause analysis

Requirements

Engineering Degree - BE/ME/BTech/MTech/BSc/MSc.
Technical certification in multiple technologies is desirable.

Mandatory Skills :-

10+ years of experience as a Database Developer or similar role.
Strong expertise in SQL Server and Azure SQL.
Advanced proficiency in T-SQL, including performance tuning and query optimization.
Hands-on experience with Databricks and Apache Spark.
Solid understanding of data warehousing concepts, dimensional modelling, and SCD.
Experience working in Azure cloud environments.
Strong analytical, problem-solving, and communication skills.