Data Engineer

Antal International
Municipality of Madrid, Spain
20 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English, Spanish
Experience level
Senior

Job location

Remote
Municipality of Madrid, Spain

Tech stack

Airflow
Amazon Web Services (AWS)
Azure
Databases
Data Architecture
ETL
Database Design
Elasticsearch
Python
MariaDB
MongoDB
NoSQL
RabbitMQ
TensorFlow
SQL Databases
TypeScript
Google Cloud Platform
PyTorch
Deep Learning
Keras
Kafka
NestJS

Job description

We are looking for a Senior Data Engineer to join the AI Team at a leader in the audiovisual industry and will work closely with data scientists, ML engineers and fact-checkers to design the next generation of intelligent systems that can automatically verify information and make a meaningful impact in the fight against misinformation. Responsibilities

  • Design and optimize data pipelines for audiovisual data processing.
  • Maintain and scale cloud-based data platforms.
  • Collaborate with cross-functional teams to deliver data-driven solutions., + Full remote work, with the option to join a coworking space at our headquarters if you're based in Madrid.
  • Offsites and team-building activities that foster collaboration and strengthen team bonds.
  • A positive work environment where your work truly matters.

Requirements

  • At least 4 years of experience as a Data Engineer.

  • Strong proficiency in building API endpoints using Python (FastAPI) or TypeScript (Nest.js).

  • Expertise in SQL (MariaDB) and NoSQL (MongoDB) database design and maintenance.

  • Familiarity with event-driven architectures (Kafka, RabbitMQ, NATS, etc.).

  • Proven experience in ETL/ELT pipeline development.

  • Knowledge of cloud platforms (AWS, GCP, Azure) and CI/CD pipelines.

  • Hands-on experience with vector databases (Pinecone, ElasticSearch, FAISS).

  • Understanding of data quality and governance best practices.

  • Strong proficiency in SQL and Python.

  • Ability to work in a fast-paced, collaborative environment.

  • Language: Fluent in Spanish and English. Nice to Have

  • You are knowledgeable about modern data architecture patterns (e.g., data mesh, medallion architecture...)

  • Your are familiar with workflow orchestration tools like Airflow, Prefect or Kubeflow.

  • You have experience with deep learning frameworks (e.g., PyTorch, TensorFlow, Keras).

Apply for this position