Data Engineer
Sólo para miembros registrados
2 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
€ 65KJob location
Remote
Tech stack
Airflow
Automation of Tests
Cloud Computing
Continuous Integration
Data as a Services
Data Validation
Information Engineering
ETL
JSON
Python
Management of Software Versions
Data Processing
Data Management
Data Pipelines
Job description
- Design, develop, and maintain scalable ETL pipelines using Python.
- Work extensively with JSON and JSON Schema to ensure structured data.
- Implement and maintain data validation frameworks to ensure data quality.
- Orchestrate and manage workflows using Apache Airflow, Prefect, or similar tools.
- Manage schema registries, including schema versioning and controlled evolution.
- Align datasets with controlled vocabularies and ontologies to ensure semantic consistency.
- Utilize cloud-based data services for scalable data processing and storage.
- Develop and support automated testing and monitoring for data reliability.
Requirements
A leading recruitment firm is looking for an experienced Data Engineer for a 6-month contract. The role is fully remote within Spain, focusing on designing, building, and maintaining scalable ETL pipelines using Python. Candidates must have strong Data Engineering experience, particularly with JSON and cloud platforms, and be able to work independently. EU citizenship is mandatory. This is a fantastic opportunity to contribute to key data initiatives in a dynamic environment., * Strong experience in Data Engineering, particularly Python-based ETL development.
- Solid understanding of JSON, JSON Schema, and data modeling principles.
- Hands-on experience with workflow orchestration tools (Airflow, Prefect, or equivalent).
- Experience implementing data validation, testing, and monitoring frameworks.
- Familiarity with schema registry tools and schema versioning practices.
- Experience working with cloud data platforms and services.
- Strong understanding of CI/CD principles applied to data pipelines.
- Ability to work independently in a fully remote environment.
- EU citizenship and current residence in Spain (mandatory)., Data Engineering ETL development using Python JSON and JSON Schema Workflow orchestration (Airflow, Prefect) Data validation and testing Cloud data platforms CI/CD principles Ability to work independently