Senior Azure Data Engineer

Korn/Ferry International
Atlanta, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Atlanta, United States of America

Tech stack

API
Agile Methodologies
Business Analytics Applications
Azure
Business Intelligence
Software as a Service
Databases
Continuous Integration
Data Architecture
Data Validation
Information Engineering
Data Governance
Data Infrastructure
Data Transformation
Data Security
DevOps
Python
Korn Shell
Metadata
Operational Data Store
DataOps
SQL Databases
Data Processing
Azure
Microsoft Fabric
Data Lineage
Data Management
Software Version Control
Data Pipelines

Job description

The Senior Azure Data Engineer role is focused on building and maintaining the scalable data foundation that powers enterprise reporting, analytics, and business decision-making across the organization.

At a high level, this person will serve as the bridge between raw operational data and trusted business insights-ensuring data from multiple systems is centralized, standardized, validated, and delivered in a way that supports reliable reporting and long-term scalability.

This is not simply a pipeline-development role - it is a strategic data engineering position focused on creating a governed, analytics-ready data environment that enables consistency, transparency, and trust across the business. The role will play a key part in improving data quality, reducing reporting issues, and supporting a modern enterprise data platform built around Microsoft Fabric and Azure technologies., Data Engineering & Pipelines

  • Design, build, and maintain scalable, reliable data pipelines using Microsoft Fabric (Data Factory, Lakehouse, Warehouses, Notebooks).
  • Ingest data from diverse sources (databases, APIs, files, SaaS platforms) into centralized data platforms.
  • Implement efficient batch and incremental data processing patterns.
  • Monitor, troubleshoot, and optimize pipeline performance, reliability, and cost.

Data Transformation & Standardization

  • Cleanse, transform, and standardize data across multiple systems to establish consistent definitions and metrics.
  • Engineer curated, analytics-ready datasets for reporting, dashboards, and downstream analytics tools.
  • Apply data modeling best practices to support enterprise reporting and self-service analytics.

Data Quality & Validation

  • Implement data validation, reconciliation, and quality checks to ensure accuracy, completeness, and reliability.
  • Partner with analytics and business teams to define and enforce data quality rules.
  • Proactively identify and remediate data issues before they impact reporting.

Data Governance & Metadata

  • Manage and mitigate schema drift across pipelines and datasets.
  • Build and maintain data catalogs, including business-friendly metadata, descriptions, and ownership.
  • Enable and maintain data lineage to provide transparency into data sources, transformations, and downstream consumption.
  • Support governance initiatives related to data standards, auditability, and compliance.

Collaboration & Enablement

  • Collaborate with IT, BI developers, analysts, and stakeholders to align system knowledge and data requirements with scalable, enterprise-grade solutions.
  • Contribute to data engineering best practices, standards, and documentation.

Requirements

  • 5+ years of experience as a Data Engineer or in a similar role.
  • Strong experience with Azure data services, with hands-on expertise in Microsoft Fabric.
  • Familiarity with medallion (bronze/silver/gold) data architecture patterns.
  • Proven experience designing and maintaining end-to-end data pipelines.
  • Solid SQL and Python skills and experience with data transformation and modeling.
  • Experience handling schema evolution and schema drift.
  • Hands-on experience with data quality validation and reconciliation processes.
  • Demonstrated experience in data governance concepts such as cataloging, metadata, and lineage.
  • Strong problem-solving skills and attention to detail.
  • Experience with CI/CD, version control, and infrastructure-as-code in data platforms.
  • Knowledge of data security, access controls, and compliance requirements.
  • Experience working in an Agile or DevOps environment.

What Success Looks Like

  • Reliable, well-documented pipelines delivering trusted, standardized data.
  • Clear visibility into data lineage, ownership, and quality.
  • Reduced data issues impacting reporting and analytics.
  • A scalable, governed data platform that supports current and future business needs.

Apply for this position