Lead Data Engineer

OPEN QUEUE LLC

Atlanta, GA, United States

4 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Compensation

$75,000.0 - $100,000.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Data Analysis Microsoft Azure Big Data Cloud Database Software Documentation Information Engineering Data Governance Extract Transform Load (ETL) Data Transformation Data Mining Data Warehousing IBM InfoSphere DataStage

+16 more

DevOps Python (Programming Language) Meta-Data Management Power BI Azure Data Lake SQL Databases Tableau (Software) Azure Data Factory Netezza Snowflake Data Build Tool (dbt) Containerization Pyspark Azure Synapse Analytics Data Pipelines Serverless Computing

Job description

Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake, and DBT.
Build and maintain data integration workflows from various data sources to Snowflake.
Write efficient and optimized SQL queries for data extraction and transformation.
Work with stakeholders to understand business requirements and translate them into technical solutions.
Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
Provide technical leadership and mentorship to junior data engineers.
Maintain and enforce data quality, governance, and documentation standards.
Collaborate with data analysts, architects, and DevOps teams in a cloud-native environment.

Requirements

Must-Have Skills: Strong experience with Azure Cloud Platform services. Proven expertise in Azure Data Factory (ADF) for orchestrating and automating data pipelines. Proficiency in SQL for data analysis and transformation. Hands-on experience with Snowflake and SnowSQL for data warehousing. Practical knowledge of DBT (Data Build Tool) for transforming data in the warehouse. Experience working in cloud-based data environments with large-scale datasets. Good-to-Have Skills: Experience with DataStage, Netezza, Azure Data Lake, Azure Synapse, or Azure Functions. Familiarity with Python or PySpark for custom data transformations. Understanding of CI/CD pipelines and DevOps for data workflows. Exposure to data governance, metadata management, or data catalog tools. Knowledge of business intelligence tools (e.g., Power BI, Tableau) is a plus. Qualifications: Bachelor s degree in Data Engineering or a related field. 8+ years of experience in data engineering roles using Azure and Snowflake. Strong problem-solving, communication, and collaboration skills For applications and inquiries, contact:hirings@openkyber.com

Benefits & conditions

$144,000-210,000 per year Cargill’s size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sustainable way. Cargill is a family comp…
15 days ago +