Azure Data Engineer

Capitole

Municipality of Vitoria-Gasteiz, Spain

3 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Working hours

Shift work

Languages

English, Spanish

Job location

Municipality of Vitoria-Gasteiz, Spain

Tech stack

Agile Methodologies

Airflow

Azure

Big Data

Cloud Computing

Data Integration

ETL

Data Systems

Data Visualization

DevOps

Python

Power BI

SQL Databases

Data Processing

Data Storage Technologies

Cloud Platform System

Data Ingestion

Azure

Grafana

Spark

Containerization

Kubernetes

Docker

Jenkins

Databricks

Programming Languages

Control M

Job description

Implement and manage cloud data storage systems.
Collaborate with data scientists and analysts to understand data requirements and provide suitable solutions.
Ensure data quality, integrity, and security.
Automate data ingestion, cleaning, and transformation processes.
Monitor the performance of data systems and troubleshoot issues as needed.
Optimizing performance and scalability of Big Data solutions.
Strong critical thinking and problem solving skills.

Requirements

We are seeking a Senior Data Engineer to design, build, and maintain scalable data processing pipelines.
The ideal candidate will have expertise in SQL, ETL processes, and cloud technologies. You will collaborate closely with Data Scientists to ensure data integration, quality and support advanced analytics.

TECHNICAL KNOWLEDGE

Knowledge of Programming Languages: Proficiency in Python.
SQL Skills: Expertise in Joins, Group By, subqueries, and temporary tables.
Strong knowledge in Apache Spark.
Cloud Platform: experience with cloud platforms such as Azure. MUST: Azure, Data Factory and Databricks.
Data Orchestration Tools: Familiarity with data orchestration tools like Azure Data Factory, Airflow, Control-M, or similar.
DevOps Experience: Hands-on experience with DevOps tools such as Azure DevOps, Jenkins, etc.

Desirable:

Visualization Tools: Knowledge of visualization tools such as PowerBI, Grafana, etc.
Containerization Technologies: Proficiency with Docker and Kubernetes.
Agile Methodologies: Understanding of agile methodologies.
Certifications: Certifications in cloud technologies or big data are a plus.

Business skills:

Strong critical thinking and problem solving skills.
Ability to work individually without much direction while also working as part of a team towards a common goal.
Good written and oral communication skills.
Results-oriented, self-directed ability to drive change in an unstructured environment.
Time management skills.
International experience and multicultural skills are highly valued., * Fluent English / Spanish (C1) ?️