Cloud Data Engineer

Nuevo Remoto
Madrid, Spain
1 day ago
Apply on www.adzuna.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
4 years minimum
Working hours
Regular working hours
Languages
English
Job source

Tech stack

OpenTofu Artificial Intelligence Amazon Web Services Microsoft Azure Bash Shell Cloud Computing Cloud Database Continuous Integration Data Architecture Information Engineering Extract Transform Load (ETL) Identity and Access Management
+14 more
Python (Programming Language) Operational Databases Cloud Services DataOps Software Engineering SQL Databases Pulumi Google Cloud Apache Spark Infrastructure as Code (IaC) Pyspark Machine Learning Operations Terraform Databricks

Job description

SIX is recruiting a data platform engineer to work on the company wide data platform. In this role, you will be part of a cross-functional team responsible for both designing and implementing a reliable platform for analytics and data science, as well as consulting internal customers who use the platform across the organization., Be part of an international team that designs and maintains a mature cloud native data science platform, currently serving more than 14 internal analytics teams and 600+ users. Closely collaborate with key stakeholders from business data science teams and IT data engineering teams to enable them on the platform. Identify new requirements, analyze platform suitability, propose best practices and existing solutions through demos… Act as a hands-on data engineer to onboard new use cases and optimize existing ones, build production ready ETL pipelines, ML/AI use cases and reporting solutions. Implement new infrastructure components with Infrastructure as code (IaC), as well as creating templates to ensure best practices and standardization among analytics teams.

Requirements

4+ years of practical experience building production data pipelines, data modeling and BI tools in the cloud. Experience with Lakehouse architecture, preferably Databricks, with a strong knowledge of Spark and Open Table formats (Delta and/or Iceberg). Proficiency with Python (PySpark) and SQL with a solid understanding of software development and automation concepts like CI/CD to build production data and ML pipelines (DataOps/MLOps). Basic knowledge of cloud foundation services (IAM, networking, storage…), cloud costs management (FinOps) as well as tools to manage cloud infrastructure with IaC (Terraform/OpenTofu, Pulumi, bash scripting…) on Microsoft Azure (our primary cloud service provider) and/or Amazon Web Services, Google Cloud Platform. Growth mindset and a very proactive attitude for continuous learning and development. Good presentation and communication skills. Fluency in written and spoken English.

About the company

BME - Bolsas y Mercados Españoles - drives the transformation of financial markets and belongs to SIX, the third largest exchange group in Europe.

What sets us apart drives us ahead: between local roots and global relevance, we are a unique blend of tradition and future, of foundation and growth. We value bright minds and inspire them to grow with their ideas. Come and shape the future of finance with us.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.es
Prepare application

Good distractions

Loading talks and stories from around this role…