Azure Data Engineer

Exclusive Networks
Municipality of Madrid, Spain
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Municipality of Madrid, Spain

Tech stack

Agile Methodologies
Azure
Batch Processing
Continuous Integration
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Systems
DevOps
Document-Oriented Databases
Monitoring of Systems
SQL Azure
NoSQL
Performance Tuning
Azure
Systems Integration
Unstructured Data
Privacy Controls
Data Ingestion
Microsoft Power Automate
Azure
System Availability
Data Lake
Information Technology
Data Analytics
Bicep
Cosmos DB
Data Management
Terraform
Azure
Data Pipelines
Serverless Computing
Azure
Databricks

Requirements

Azure Data Engineer - Madrid (Full Time) Exclusive Networks is looking for an experienced Azure Data Engineer to join our Global IT team. The role focuses on building and maintaining data platforms within the Data & Analytics domain, designing robust, scalable data pipelines and architectures that support business requirements. Responsibilities - Data Platform Development - Design, develop, and maintain scalable, efficient data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. Implement data ingestion, transformation, and integration workflows from multiple data sources. - Data Modeling and Architecture - Create and manage data models for structured and unstructured data, build and optimize storage solutions using Azure SQL Database and Data Lake. Design and implement scalable architectures to support real-time and batch processing. - Performance Optimization - Monitor and improve the performance of data pipelines and query execution. Optimize costs and resource utilization of Azure services such as Databricks and Synapse. - Collaboration with Stakeholders - Work closely with data scientists, analysts, business teams and DevOps engineers to understand requirements, deliver data solutions, and deploy services via CI/CD pipelines. - Troubleshooting and Maintenance - Identify and resolve issues in data pipelines, data quality, and integrations. Perform regular system monitoring, maintenance and updates to ensure high availability. - Automation and Innovation - Automate repetitive tasks using Azure Functions and Logic Apps. Stay updated on new Azure tools and recommend innovative solutions. - Documentation and Reporting - Document data workflows, technical designs and best practices. Provide regular updates and performance reports to stakeholders. Qualifications - Bachelor's or Master's degree in Computer Science, Data Science, Information Technology or related field. - 5+ years of experience as an Azure Data Engineer or Consultant, with strong data engineering, architecture and ETL/ELT pipeline knowledge. - Proficiency with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Data Lake, Azure SQL Database, Cosmos DB and other relational/NoSQL databases. - Experience in data governance, privacy standards, and security best practices. - Experience with DevOps practices, CI/CD pipelines, automation tools, infrastructure-as-code (ARM Templates, Bicep, Terraform). - Strong communication, problem-solving and collaboration skills, adaptable to Agile environments. - Relevant certifications such as Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect Expert, Azure Fundamentals or CDMP are a plus. Equal Opportunity Employment We are a committed Equal Opportunity Employer. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, disability status or any similar characteristic. Employment decisions are based solely on qualifications, merit and business need. All applicants are invited to review our Diversity and Inclusion Policy.

Apply for this position