Data Engineer (Databricks, Python, Spark)

Zurich Insurance
Barcelona, Spain
4 days ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
2 years minimum
Working hours
Regular working hours
Languages
English

Tech stack

Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Big Data Cloud Database Information Engineering Data Systems Database Queries Github Python (Programming Language) Cloud Services
+7 more
SQL Databases Large Language Models Apache Spark Data Lakes Pyspark Data Pipelines Databricks

Job description

Experteer Overview In this Data Engineer role within Investment Management, you will design and maintain a cloud-based data hub and pipelines that enable large-scale analytics for investment teams.You’ll work with a global, collaborative group and continuously learn to apply the latest data engineering and AI concepts.Your contributions will unlock value from financial data sources like Bloomberg and support cross-functional investment stakeholders.This is a hands-on, growth-oriented opportunity to shape a key platform in a tech-driven environment.Compensaciones / Beneficios * Design, develop, enhance, and maintain complex data pipelines for business-critical operations and analytics * Support internal Investment Management clients and address their needs * Improve platform capabilities and influence technology choices and standards * Stay current with evolving data engineering and AI technologies and share knowledge with the team * Collaborate with experts across domains to deliver real-world data solutions * Contribute to a culture of continuous learning and creative input Responsabilidades * 3+ years of Data Engineering experience with 2+ years designing and building Databricks data pipelines * Azure cloud experience preferred (AWS/GCP also considered) * 2+ years Python/PySpark/SparkSQL and/or Scala * 2+ years Big Data pipelines or DAG tools (Data Factory, Airflow, dbt) * 2+ years Spark experience (Databricks Spark and Delta Lake) * 2+ years implementing Big Data solutions in a cloud ecosystem (Data/Delta Lakes) * 2+ years SQL with complex queries * Experience with GitHub and CI/CD pipelines (desirable) * Experience with financial data providers such as Bloomberg (desirable) * Experience with AI/LLMs, Databricks Genie or similar tools * Proficiency in English * Positive attitude and can-do mentality Requisitos principales * flexible working model * home office setup allowance * training (languages) * health insurance * life and accident insurance * stock options

Requirements

Compensaciones / Beneficios * Design, develop, enhance, and maintain complex data pipelines for business-critical operations and analytics * Support internal Investment Management clients and address their needs * Improve platform capabilities and influence technology choices and standards * Stay current with evolving data engineering and AI technologies and share knowledge with the team * Collaborate with experts across domains to deliver real-world data solutions * Contribute to a culture of continuous learning and creative input Responsabilidades * 3+ years of Data Engineering experience with 2+ years designing and building Databricks data pipelines * Azure cloud experience preferred (AWS/GCP also considered) * 2+ years Python/PySpark/SparkSQL and/or Scala * 2+ years Big Data pipelines or DAG tools (Data Factory, Airflow, dbt) * 2+ years Spark experience (Databricks Spark and Delta Lake) * 2+ years implementing Big Data solutions in a cloud ecosystem (Data/Delta Lakes) * 2+ years SQL with complex queries * Experience with GitHub and CI/CD pipelines (desirable) * Experience with financial data providers such as Bloomberg (desirable) * Experience with AI/LLMs, Databricks Genie or similar tools * Proficiency in English * Positive attitude and can-do mentality Requisitos principales * flexible working model * home office setup allowance * training (languages) * health insurance * life and accident insurance * stock options

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all