Data Engineer - ETL & Azure Data Platforms

THE JUDGE GROUP, INC.
Minneapolis, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 162K

Job location

Minneapolis, United States of America

Tech stack

Agile Methodologies
Data analysis
CA Workload Automation Ae
Azure
Cloud Computing
Code Generation
Code Review
Information Systems
Computer Programming
Databases
Continuous Integration
Data Cleansing
Information Engineering
Data Governance
Data Integration
Data Integrity
ETL
Data Systems
Relational Databases
Database Queries
Software Debugging
DevOps
Github
Job Scheduling
Python
Liquibase
Microsoft SQL Server
SQL Azure
Oracle Applications
Performance Tuning
Scrum
Query Optimization
Software Tools
Software Engineering
SQL Stored Procedures
SQL Databases
SQL Server Integration Services
Teradata
T-SQL
Workflow Management Systems
Enterprise Data Management
Data Processing
Enterprise Software Applications
Cloud Platform System
Azure
Snowflake
Database Optimization
Spark
HybridCloud
Indexer
GIT
Pandas
Data Lake
Information Technology
Data Lineage
Data Analytics
Data Management
Code Restructuring
Data Pipelines
ServiceNow
Databricks
Artifactory

Job description

We are seeking a highly skilled Data Engineer to design, develop, optimize, and support enterprise data integration solutions across hybrid cloud and on-premises environments. The ideal candidate will have strong expertise in ETL development, advanced SQL programming, Python, Azure data services, and database optimization, with a passion for building scalable and reliable data pipelines that enable analytics and business intelligence initiatives., This role requires collaboration with business stakeholders, data analysts, architects, and software engineering teams in an Agile environment to deliver high-quality data solutions., * Design, develop, and maintain scalable ETL and ELT pipelines using SSIS, Azure Data Factory, Python, and SQL.

  • Build and optimize data integration solutions across SQL Server, Azure SQL, Oracle, Teradata, and cloud-based platforms.
  • Develop advanced SQL solutions including stored procedures, views, functions, and performance optimization strategies.
  • Ensure data accuracy, quality, integrity, and lineage throughout the data lifecycle.
  • Implement monitoring, troubleshooting, and support processes for enterprise data pipelines.
  • Collaborate with cross-functional teams to gather requirements and translate business needs into technical solutions.
  • Participate in Agile ceremonies including sprint planning, backlog refinement, and retrospectives.
  • Create and maintain technical documentation, data mappings, and operational procedures.
  • Support production environments, investigate data issues, and implement corrective actions.
  • Drive continuous improvement through automation, testing, code reviews, and DevOps best practices.
  • Utilize modern analytics and data engineering tools, including Databricks and Snowflake, to support advanced data processing initiatives.

Technical Skills Data Engineering & Integration

  • ETL/ELT Development
  • SSIS
  • Azure Data Factory (ADF)
  • Data Integration
  • Data Management
  • Data Cleansing
  • Data Lineage
  • Data Integrity

Databases & SQL

  • Microsoft SQL Server
  • Azure SQL
  • Oracle
  • Teradata
  • Advanced T-SQL
  • Database Performance Tuning
  • Query Optimization

Programming

  • Python
  • Pandas

Cloud & Analytics

  • Microsoft Azure
  • Databricks
  • Snowflake
  • Data Analytics

DevOps & Automation

  • GitHub
  • GitHub Actions
  • CI/CD Pipelines
  • Liquibase
  • ServiceNow
  • AutoSys
  • Artifactory
  • Harness

Requirements

  • Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or equivalent practical experience.
  • 5+ years of experience designing, developing, and supporting ETL processes using SSIS, Azure Data Factory (ADF), or similar technologies.
  • 5+ years of experience working with relational database management systems including SQL Server, Azure SQL, Oracle, and/or Teradata.
  • 5+ years of experience writing and optimizing advanced T-SQL, including complex queries, stored procedures, functions, indexing, and performance tuning.
  • 3+ years of experience in Data Engineering and enterprise data integration.
  • 3+ years of experience with database performance tuning and optimization.
  • 2+ years of experience working in Agile software development environments.
  • 2+ years of experience with Azure Data Factory and Azure database technologies.
  • 2+ years of experience with Python and Pandas for data processing and automation.
  • Experience implementing data quality, data governance, data lineage, and data integrity best practices.

Preferred Qualifications

  • Experience with Databricks, Apache Spark, Delta Lake, and workflow orchestration.
  • Experience working with Snowflake and modern cloud data platforms.
  • Experience with CI/CD and DevOps tools including GitHub, Git Actions, Artifactory, Harness, and IDP platforms.
  • Experience with database change management tools such as Liquibase.
  • Experience with enterprise job scheduling tools such as AutoSys.
  • Experience developing automated testing frameworks using Hyper Execute, Octane, Robot Framework, or similar tools.
  • Familiarity with ServiceNow and enterprise application support processes.
  • Experience leveraging AI-assisted development tools for code generation, debugging, refactoring, testing, and workflow automation., * Strong analytical and problem-solving skills.
  • Exceptional attention to detail and commitment to data quality.
  • Excellent verbal, written, and interpersonal communication skills.
  • Ability to work independently and collaboratively in a fast-paced environment.
  • Strong customer-focused mindset with the ability to understand business needs and recommend technical solutions.
  • Proven ability to manage multiple priorities and meet deadlines.
  • Experience partnering with both technical and non-technical stakeholders.

This position is ideal for a data engineering professional who enjoys building scalable, high-performance data solutions within a modern Azure and enterprise data ecosystem.

Apply for this position