Azure Data Factory (ADF) Developer

Isite Technologies Inc
Texas City, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Texas City, United States of America

Tech stack

Azure
Cloud Database
Cloud Storage
Code Review
Continuous Integration
Information Engineering
ETL
Data Transformation
Data Migration
Data Warehousing
Python
Key Management
Microsoft SQL Server
SQL Azure
Oracle Applications
Performance Tuning
Scrum
Query Optimization
Power BI
Standard Sql
Azure
SAP Applications
SQL Stored Procedures
SQL Databases
Data Streaming
Scripting (Bash/Python/Go/Ruby)
Azure
Snowflake
Change Data Capture
GIT
Microsoft Fabric
Data Lake
PySpark
Information Technology
REST
Azure
Data Pipelines
Databricks

Job description

We are looking for a Senior Azure Data Factory (ADF) Developer with 10+ years of experience in Data Engineering, ETL development, and cloud-based data integration. The ideal candidate should have strong expertise in Azure Data Factory, Azure Data Lake, Azure SQL, Databricks, Synapse Analytics, and Azure DevOps, with experience designing scalable, secure, and high-performance data pipelines., * Design, develop, and maintain enterprise-scale ETL/ELT solutions using Azure Data Factory (ADF).

  • Build and optimize data pipelines, Mapping Data Flows, Linked Services, Datasets, Triggers, and Integration Runtimes.
  • Integrate data from SQL Server, Oracle, Azure SQL Database, Azure Blob Storage, ADLS Gen2, REST APIs, SAP, and other enterprise systems.
  • Design scalable cloud-based data integration architectures on Microsoft Azure.
  • Develop data transformation logic using Azure Databricks, PySpark, and SQL.
  • Implement incremental data loading, CDC (Change Data Capture), and data migration strategies.
  • Optimize ETL performance and troubleshoot pipeline failures.
  • Work closely with business analysts, data architects, developers, and stakeholders to gather requirements.
  • Develop and optimize SQL queries, stored procedures, views, and data models.
  • Implement CI/CD pipelines using Azure DevOps and Git.
  • Monitor data pipelines and resolve production issues.
  • Ensure data quality, governance, security, and compliance standards.
  • Mentor junior developers and participate in code reviews and design discussions.

Requirements

  • 10+ years of IT experience in Data Engineering, ETL, and Data Warehousing.
  • 5+ years of hands-on experience with Azure Data Factory (ADF).
  • Strong experience in Azure Data Lake Storage (ADLS Gen2).
  • Expertise in Azure SQL Database and SQL Server.
  • Strong SQL development and query optimization skills.
  • Experience with Azure Databricks and PySpark.
  • Knowledge of Azure Synapse Analytics.
  • Experience building Mapping Data Flows in ADF.
  • Experience with Azure Blob Storage.
  • Knowledge of REST API integration.
  • Experience with Azure DevOps, Git, and CI/CD pipelines.
  • Strong understanding of ETL/ELT concepts and Data Warehousing.
  • Experience with performance tuning and pipeline optimization.
  • Excellent analytical, troubleshooting, and communication skills.

Preferred Skills

  • Microsoft Azure Data Engineer certification (DP-203).
  • Experience with Power BI.
  • Experience with Snowflake or Microsoft Fabric.
  • Knowledge of Python scripting.
  • Experience with Delta Lake.
  • Familiarity with Agile/Scrum methodology.
  • Experience with Azure Key Vault and Azure Monitor.

Technologies

  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure SQL Database
  • SQL Server
  • Azure Synapse Analytics
  • Azure Databricks
  • PySpark
  • Azure Blob Storage
  • Azure DevOps
  • Git
  • Power BI
  • REST APIs
  • SQL
  • Python
  • Delta Lake
  • Microsoft Fabric (Preferred)

Apply for this position