Senior Data Engineer Databricks

Deutsche Telekom AG
Municipality of Granada, Spain
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Municipality of Granada, Spain

Tech stack

Amazon Web Services (AWS)
Azure
Code Review
Computer Programming
Continuous Integration
Data Architecture
Data Auditing
Information Engineering
Data Integration
ETL
Data Warehousing
Digital Architecture
Distributed Computing Environment
Python
Data Streaming
Cloud Platform System
Data Ingestion
Sql Optimization
Spark
Data Strategy
GIT
Data Lake
PySpark
Data Lineage
Data Management
Data Pipelines
Databricks

Job description

Experteer Overview As a Databricks Senior Data Engineer, you will design and evolve ETL/ELT processes to support business needs, building scalable data pipelines in Data Lake, Data Warehouse, or Lakehouse environments.You will ensure data quality, set standards, and mentor the data engineering team while engaging with clients on data strategy.You will collaborate with architects, BI and data science teams to maintain a coherent data ecosystem and optimize performance in production.This role offers impact through shaping data platforms and shaping data-driven decisions in a client-facing, technically-focused environment.Compensaciones / Beneficios- Definition, design and evolution of ETL/ELT processes to align with business requirements- Design and implement data ingestion, transformation and persistence in Data Lake/Data Warehouse/Lakehouse environments- Establish data quality assurance with controls, validations, business rules and traceability- Define technical standards, best practices, and development patterns for data pipelines- Act as technical reference for the Data Engineering team: support, code reviews, mentoring- Direct client dialogue as technical expert, contributing to data strategy decisions- Coordinate with architects, BI and data science teams to ensure data ecosystem coherence- Optimize performance, scalability and reliability of data processes in production- Document architecture, data flows, and critical processesResponsabilidades- More than 6 years of experience in Data Engineering and data integration projects- Extensive experience in defining and implementing complex ETL/ELT processes- Advanced Databricks domain- Advanced Python programming skills- Advanced SQL skills- Experience with distributed processing using Spark/PySpark- Experience in designing modern data architectures (Data Lake, Data Warehouse, Lakehouse)- Solid knowledge of data quality assurance (validations, controls, reconciliation, data lineage)- Experience working in cloud environments (Azure, AWS or GCP)- Knowledge and use of CI/CD applied to data pipelines- Experience with version control using Git applied to data pipelines- Ability to technically lead teams- Strong communication skills- Ability to communicate with technical and business profiles- Experience working with agile methodologiesRequisitos principales-

Requirements

More than 6 years of experience in Data Engineering and data integration projects

  • Extensive experience in defining and implementing complex ETL/ELT processes
  • Advanced Databricks domain
  • Advanced Python programming skills
  • Advanced SQL skills
  • Experience with distributed processing using Spark/PySpark
  • Experience in designing modern data architectures (Data Lake, Data Warehouse, Lakehouse)
  • Solid knowledge of data quality assurance (validations, controls, reconciliation, data lineage)
  • Experience working in cloud environments (Azure, AWS or GCP)
  • Knowledge and use of CI/CD applied to data pipelines
  • Experience with version control using Git applied to data pipelines
  • Ability to technically lead teams
  • Strong communication skills
  • Ability to communicate with technical and business profiles
  • Experience working with agile methodologiesRequisitos principales

About the company

Die Deutsche Telekom ist Europas größtes Telekommunikationsunternehmen und weltweit in mehr als 50 Ländern vertreten. Mit rund 207.000 Mitarbeitenden erwirtschaftete sie im Geschäftsjahr 2022 einen Umsatz von 114,4 Milliarden Euro. 

Wir entwickeln Technologie und Innovationen für Menschen, Umwelt und Unternehmen, um damit gemeinsame Herausforderungen zu bewältigen.

Sei dabei und gestalte mit uns die Zukunft, mache den Alltag einfacher und sicherer mit KI, entwickle Lösungen für das Internet der Dinge oder digitalisiere Prozesse mit uns als Marktführer im Bereich Cloud Computing. 

Bei der Telekom teilen wir mehr als den Arbeitgeber. Wir teilen die gleichen Werte und setzen uns für diese ein. Unser Ziel ist es, den stetigen Wandel zu treiben und ihn zu nutzen, um die Welt zu einem inklusiveren und lebenswerteren Ort zu machen. Nur indem wir den Status quo hinterfragen, können wir ein besseres Morgen erschaffen. Jede und jeder von uns kann ein Katalysator für Veränderung und dieser Funke der Inspiration sein, der Fortschritt ermöglicht. Ob du Einsteiger*in bist oder bereits begonnen hast, bevor es Computer Displays gab: Wenn du den Willen hast, Dinge zu verändern, mit uns gemeinsam auf die Reise gehen und in einem globalen Netzwerk wachsen willst, bist du hier richtig!

 #QuestionTodayCreateTomorrow


Werde Teil von uns: www.telekom.com/de/karriere/question-today-create-tomorrow 




Apply for this position