Data Engineer Ingles
IRIUM
Municipality of Madrid, Spain
9 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
SpanishJob location
Municipality of Madrid, Spain
Tech stack
Agile Methodologies
Artificial Intelligence
Airflow
Unit Testing
Cloud Computing
Hadoop
Systems Development Life Cycle
Shell Script
Software Engineering
SQL Databases
Spark
Kubernetes
Programming Languages
Data Generation
Job description
- Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service.
- Implement data transformation and quality to ensure data consistency and accuracy. Utilize programming languages such as Scala and SQL and tools like Spark for data transformation and enrichment operations.
- Set up CI/CD pipelines to automate deployments, unit testing and development management.
- Write and conduct unit and validation tests to ensure accuracy and integrity of code developed.
- Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly).
- Writing technical documentation (specifications, operational documents) to ensure knowledge capitalization.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Foster a culture of continuous learning and improvement within the team.
Requirements
- Shell script
- Software Development Lifecycle (SDLC) awareness
- Agile principles and ceremonies
- Design effective prompts to leverage Gen AI tools across IT domains (e.g., development, testing, data generation, documentation) during the development stage.
Benefits & conditions
- Lugar de trabajo: HIBRIDO Madrid (Zona Madrid Rio) - 4 presencial/ 1 remoto
- Contrato indefinido con IRIUM
- Retribución flexible
- Banda salarial: Según valía y experiencia (30- 38K)
- 23 días de vacaciones ️
- Buen clima laboral ️ ️
- Acceso ilimitado a formación tecnológica puntera en modalidad barra libre.
- Club de beneficios para empleados con descuentos directos y miles de ofertas en marcas, hoteles, agencias de viaje, cines, ropa…, IRIUM es una empresa formada por profesionales con inquietudes, dinámicos y resolutivos. Nuestros valores son la responsabilidad y el compromiso con el trabajo bien hecho, este es el espíritu que buscamos en IRIUM, sea cual sea tu edad, si te reconoces ¡esta es tu empresa!