Databricks Engineer
VBEYOND CORP
Chicago, United States of America
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Chicago, United States of America
Tech stack
Data analysis
Big Data
Code Review
Databases
Information Engineering
ETL
Data Transformation
Data Systems
Data Warehousing
Database Development
Database Security
Hive
Microsoft SQL Server
SQL Azure
Performance Tuning
Query Optimization
SQL Stored Procedures
SQL Databases
T-SQL
Spark
Indexer
Data Lake
PySpark
Databricks
Job description
Serve as a Senior Data Engineer, designing and delivering scalable cloud-based data solutions.
- Develop, optimize, and maintain complex SQL Server and Azure SQL databases.
- Write and optimize advanced T-SQL queries, stored procedures, functions, and views.
- Perform query tuning, indexing, and performance optimization on large datasets.
- Ensure database security, integrity, and reliability using best practices.
- Build and manage data solutions in Azure SQL Database and Databricks (Apache Spark).
- Support data transformations, analytics, and large-scale processing using Databricks, Spark SQL, Delta Lake, and PySpark/SQL.
- Design and maintain relational and dimensional data models for data warehousing.
- Implement data warehousing patterns such as Slowly Changing Dimensions (SCD).
- Support ETL/ELT processes and collaborate with data engineering and BI teams.
- Partner with stakeholders to gather and understand data requirements.
- Mentor junior developers, conduct code reviews, and enforce database standards.
- Troubleshoot production issues and perform root cause analysis.
Requirements
Require 10+ years of experience in database development and related roles.
- Must possess strong skills in SQL Server, Azure SQL, T-SQL, Databricks, Apache Spark, and data warehousing concepts.
- Strong analytical, problem-solving, and communication skills required.
- Engineering degree and technical certifications are desirable.