Lead Azure Data Engineer
Informa Business Media, Inc.
Atlanta, GA, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Data Analysis
Unit Testing
Microsoft Azure
Cloud Database
Databases
Data Validation
Information Engineering
Data Integration
Extract Transform Load (ETL)
Data Migration
Data Systems
Digital Architecture
+14 more
Distributed Computing Environment
SQL Azure
Performance Tuning
Systems Development Life Cycle
Azure Data Lake
SQL Databases
Transact-SQL
Azure Data Factory
Data Lakes
Information Technology
Data Management
Data Pipelines
Serverless Computing
Databricks
Job description
- Participate in the modernization and migration of current Azure data and analytics systems to the Databricks Lakehouse Platform.
- Support Databricks platform enablement, configuration, and deployment activities.
- Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Azure Functions, and Databricks.
- Build scalable data integration solutions across Azure Data Lake, Azure SQL Database, Azure Storage (Blob/File), and Databricks.
- Assist in optimizing ingestion and transformation processes for performance, reliability, and cost efficiency.
- Migrate legacy data pipelines, workflows, and processing logic into Databricks notebooks or Delta pipelines.
- Work with cross-functional teams to understand business requirements and translate them into technical solutions.
- Ensure all solutions comply with Marsh MMA standards for security, governance, and data quality.
- Perform data validation, unit testing, troubleshooting, and system performance tuning.
- Document architecture, workflows, design decisions, and operational procedures.
Requirements
Microsoft Windows Azure, Microsoft Windows Azure, Data Analysis, Systems Administration/Management, Database Extract Transform and Load (ETL), SQL Databases, Data Lake, Scalable System Development, Data Management, Data Migration, * Strong hands-on experience with:
- Azure Data Factory (ADF)
- SQL / T-SQL
- Azure Functions
- Azure SQL Database
- Azure Data Lake (ADLS Gen2), * Bachelors degree in Computer Science, Data Engineering, Information Technology, or related field.
- Proven experience working with cloud-based data engineering solutions, preferably in Azure ecosystems.
- Experience supporting cloud migration or modernization initiatives is a plus.
- Strong understanding of ETL/ELT concepts, data modeling, and distributed data processing.
Soft Skills
- Strong analytical and problem-solving mindset.
- Excellent communication and documentation abilities.
- Ability to collaborate with cross-functional teams across technical and business domains.
- Detail-oriented with a focus on quality and compliance.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦