Azure Data Engineer
Role details
Job location
Tech stack
Requirements
Azure Data Engineer - Madrid (Full Time) Exclusive Networks is looking for an experienced Azure Data Engineer to join our Global IT team. The role focuses on building and maintaining data platforms within the Data & Analytics domain, designing robust, scalable data pipelines and architectures that support business requirements. Responsibilities - Data Platform Development - Design, develop, and maintain scalable, efficient data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. Implement data ingestion, transformation, and integration workflows from multiple data sources. - Data Modeling and Architecture - Create and manage data models for structured and unstructured data, build and optimize storage solutions using Azure SQL Database and Data Lake. Design and implement scalable architectures to support real-time and batch processing. - Performance Optimization - Monitor and improve the performance of data pipelines and query execution. Optimize costs and resource utilization of Azure services such as Databricks and Synapse. - Collaboration with Stakeholders - Work closely with data scientists, analysts, business teams and DevOps engineers to understand requirements, deliver data solutions, and deploy services via CI/CD pipelines. - Troubleshooting and Maintenance - Identify and resolve issues in data pipelines, data quality, and integrations. Perform regular system monitoring, maintenance and updates to ensure high availability. - Automation and Innovation - Automate repetitive tasks using Azure Functions and Logic Apps. Stay updated on new Azure tools and recommend innovative solutions. - Documentation and Reporting - Document data workflows, technical designs and best practices. Provide regular updates and performance reports to stakeholders. Qualifications - Bachelor's or Master's degree in Computer Science, Data Science, Information Technology or related field. - 5+ years of experience as an Azure Data Engineer or Consultant, with strong data engineering, architecture and ETL/ELT pipeline knowledge. - Proficiency with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure Data Lake, Azure SQL Database, Cosmos DB and other relational/NoSQL databases. - Experience in data governance, privacy standards, and security best practices. - Experience with DevOps practices, CI/CD pipelines, automation tools, infrastructure-as-code (ARM Templates, Bicep, Terraform). - Strong communication, problem-solving and collaboration skills, adaptable to Agile environments. - Relevant certifications such as Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect Expert, Azure Fundamentals or CDMP are a plus. Equal Opportunity Employment We are a committed Equal Opportunity Employer. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, disability status or any similar characteristic. Employment decisions are based solely on qualifications, merit and business need. All applicants are invited to review our Diversity and Inclusion Policy.