WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer

Tecdata Engineering
Madrid, Spain
12 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
www.indeed.com

Tech stack

Amazon Web Services Cloud Computing Data Transmissions Python (Programming Language) PowerDesigner Data Processing Pyspark Control M

Job description

Buscamos un/a profesional especializado/a en Ingeniería y Desarrollo de Datos, con experiencia en entornos de gran volumen y arquitecturas Cloud sobre AWS., * Desarrollo de soluciones de procesamiento de datos con Python y PySpark.

  • Construcción, mantenimiento y optimización de pipelines de datos.
  • Monitorización de procesos batch mediante Control-M.
  • Análisis de ejecuciones, incidencias y seguimiento de mallas de procesos.
  • Revisión de logs mediante Amazon Athena para troubleshooting y análisis de rendimiento.
  • Procesos de ingesta y transmisión de información.
  • Aplicación de reglas de calidad e integridad del dato mediante DataX, Kirby y Hammurabi.
  • Modelado lógico y físico de datos mediante PowerDesigner.

Requirements

  • Experiencia en Data Engineering.
  • Python y PySpark.
  • AWS.
  • Experiencia con pipelines de datos.
  • Control-M.
  • Conocimientos en procesamiento de grandes volúmenes de datos.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

1:19 min

The true role and evolution of data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

1:29 min

Utilizing specific tooling for continuous integration and modeling

Christoph Fassbach Christoph Fassbach +1 · World Congress 2024

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

Brewing Tea over the Internet thumbnail
23:27
World Congress 2023 • about 3 years ago

Brewing Tea over the Internet

Imran Nazar

Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Business Strategies for Scaling European Tech thumbnail
29:57
World Congress 2025 • about 1 year ago

Business Strategies for Scaling European Tech

Anastasia Zemskova, Gilli Cegla, Nikola Pavesic, Vuyiswa V. M'Cwabeni

Related articles

See all