Data Engineer - Databricks, ADF, SQL - Technical Lead

Ineos Styrolution America LLC

Dallas, TX, United States

7 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

4 years minimum

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Microsoft Azure Code Review Continuous Integration Information Engineering Data Integration Extract Transform Load (ETL) Data Transformation Data Systems Data Warehousing Database Queries Dimensional Modeling Distributed Computing Environment

+20 more

Python (Programming Language) Performance Tuning Power BI Azure Data Lake SQL Stored Procedures SQL Databases Enterprise Data Management Data Logging Data Processing Freeform SQL Azure Data Factory Snowflake Apache Spark Git Data Lakes Pyspark Integration Frameworks Data Management Data Pipelines Databricks

Job description

Lead the design, development, implementation, and support of enterprise data engineering solutions using Azure Databricks, Azure Data Factory, SQL, and PySpark.
Design and optimize scalable ETL/ELT pipelines to ingest, transform, and integrate data from multiple enterprise sources.
Develop Databricks notebooks and Spark-based data processing solutions for high-volume datasets.
Build and maintain ADF pipelines, datasets, linked services, triggers, and integration workflows.
Develop and optimize complex SQL queries and data transformation processes.
Provide technical leadership to the data engineering team, including solution guidance, development standards, code reviews, and mentoring.
Troubleshoot data pipeline failures, performance bottlenecks, and production issues.
Work closely with architects, business analysts, application teams, and data consumers to translate requirements into technical solutions.
Implement data quality, validation, monitoring, logging, and error-handling mechanisms.
Support deployment and release activities across development, QA, and production environments.
Ensure solutions follow enterprise security, governance, performance, and data management standards.

Preferred Skills

Experience with Azure Data Lake Storage (ADLS Gen2), Delta Lake, Databricks Lakehouse, Unity Catalog, CI/CD/Azure DevOps, Python, Git, and Power BI would be advantageous., Description: CTG is seeking to fill a Data Engineer - Databricks / Snowflake position for our client. Location: Dallas, TX Duration: 11 months Duties: Develop and maintain…
6 days ago, Position Title: Sr. Data Engineer (SQL / Databricks) Work Mode: Hybrid 3 days WFO (Tuesday, Wednesday and Thursday) Client Office Location: Irving, TX Interview: Face-to-Face…
22 hours ago
Apply easily

Requirements

10+ years of overall experience in Data Engineering, Data Warehousing, ETL, or related data technologies.
5+ years of hands-on experience with Azure Data Factory (ADF) and Azure-based data engineering solutions.
4+ years of strong hands-on experience with Azure Databricks.
Advanced expertise in SQL, including complex queries, stored procedures, performance tuning, and data transformations.
Strong experience designing and developing ETL/ELT pipelines for large-scale enterprise data platforms.
Hands-on experience with PySpark / Spark for distributed data processing.
Experience leading data engineering teams and providing technical direction, code reviews, troubleshooting, and production support.
Strong understanding of data warehousing, dimensional modeling, data integration, and data quality.
Ability to work from Dallas, TX as required.