FULLREMOTE - Data Engineer Azure

Capitole Consulting
12 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Remote

Tech stack

Agile Methodologies
Airflow
Azure
Big Data
Cloud Computing
Data Integration
ETL
Data Systems
Data Visualization
DevOps
Python
Power BI
SQL Databases
Data Processing
Data Storage Technologies
Cloud Platform System
Data Ingestion
Azure
Grafana
Spark
Containerization
Kubernetes
Docker
Jenkins
Databricks
Programming Languages
Control M

Requirements

Capitole keeps growing and we want to do it with you! We are seeking a Senior Data Engineer to design, build, and maintain scalable data processing pipelines. The ideal candidate will have expertise in SQL, ETL processes, and cloud technologies. You will collaborate closely with Data Scientists to ensure data integration, quality and support advanced analytics. 1. TECHNICAL KNOWLEDGE Required: * Knowledge of Programming Languages: Proficiency in Python. * SQL Skills: Expertise in Joins, Group By, subqueries, and temporary tables. * Strong knowledge in Apache Spark. * Cloud Platform: experience with cloud platforms such as Azure. MUST: Azure, Data Factory and Databricks. * Data Orchestration Tools: Familiarity with data orchestration tools like Azure Data Factory, Airflow, Control-M, or similar. * DevOps Experience: Hands-on experience with DevOps tools such as Azure DevOps, Jenkins, etc. Desirable: * Visualization Tools: Knowledge of visualization tools such as PowerBI, Grafana, etc. * Containerization Technologies: Proficiency with Docker and Kubernetes. * Agile Methodologies: Understanding of agile methodologies. Certifications: Certifications in cloud technologies or big data are a plus. 2. EXPERIENCE AND SKILLS Required: +3 years of experience technical knowledge in the following technologies: * Deep Knowledge of Programming Languages: Proficiency in Python. * Strong SQL Skills: Expertise in Joins, Group By, subqueries, and temporary tables. * Cloud Platform: experience with cloud platforms such as Azure. MUST: Databricks and Data Factory. * Strong knowledge in Apache Spark. * Data Orchestration Tools: Familiarity with data orchestration tools like Azure Data Factory, Airflow, Control-M, or similar. * DevOps Experience: Hands-on experience with DevOps tools such as Azure DevOps, Jenkins, etc. Business skills: * Strong critical thinking and problem solving skills. * Ability to work individually without much direction while also working as part of a team towards a common goal. * Good written and oral communication skills. * Results-oriented, self-directed ability to drive change in an unstructured environment. * Time management skills. International experience and multicultural skills are highly valued. 3 ROLE AND RESPONSABILITIES * Implement and manage cloud data storage systems. * Collaborate with data scientists and analysts to understand data requirements and provide suitable solutions. * Ensure data quality, integrity, and security. * Automate data ingestion, cleaning, and transformation processes. * Monitor the performance of data systems and troubleshoot issues as needed. * Optimizing performance and scalability of Big Data solutions. * Strong critical thinking and problem solving skills. English: C1 We're great, but with you we'll be even better! For this you will have: - Budget of 1.200€ in individual training for you to use it in whatever you want (technological events, books

Benefits & conditions

trainings, certifications, etc.). - Follow-up with your team every month for continuous feedback. - Teleworking. - Flexible working hours to help you reconcile your professional / family life. - Private medical insurance paid in full by Capitole. - Flexible remuneration (restaurant tickets, transport and/or childcare). - WellHub (Gymforless). - Discounts on major brands for employees (Club Capitole). Get to know the whole family: - Team Buildings every two months - don't miss the summer party or the Christmas dinner! - Football team sponsored by Capitole. - Technological communities for you to share your knowledge and ideas with the other teams, sharing internal knowledge is essential!!!! - Last but not least, a TEAM! Don't you know us yet? Discover us!!! https://capitole-consulting.com/ See what people are saying about us https://www.glassdoor.es/Opiniones/Capitole-Consulting-Opiniones-E2060890.html Don't hesitate to send us your profile, we

About the company

are looking forward to meeting you! The employee will adhere to information security policies: - Will have access to confidential information related to Capitole and the project they are working on. - Must comply with the security policies and internal policies of the company and the client. - Must sign an NDA.

Apply for this position