Cloud Data Engineer

Six

Málaga, Spain

27 days ago

Apply on www.buscojobs.com.es

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience required

4 years minimum

Working hours

Regular working hours

Languages

English

Job source

www.buscojobs.com.es

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Bash Shell Cloud Computing Cloud Database Continuous Integration Data Architecture Information Engineering Extract Transform Load (ETL) Identity and Access Management Python (Programming Language)

+13 more

Operational Databases Cloud Services DataOps Software Engineering SQL Databases Pulumi Google Cloud Apache Spark Infrastructure as Code (IaC) Pyspark Machine Learning Operations Terraform Databricks

Job description

BME - Bolsas y Mercados Españoles - drives the transformation of financial markets and belongs to SIX, the third largest exchange group in Europe.What sets us apart drives us ahead: between local roots and global relevance, we are a unique blend of tradition and future, of foundation and growth. We value bright minds and inspire them to grow with their ideas. Come and shape the future of finance with us.Cloud Data EngineerMadrid, Warsaw

Working from home up to 40%

Reference**SIX is recruiting a data platform engineer to work on the company wide data platform. In this role, you will be part of a cross-functional team responsible for both designing and implementing a reliable platform for analytics and data science, as well as consulting internal customers who use the platform across the organization.What You Will DoBe part of an international team that designs and maintains a mature cloud native data science platform, currently serving more than 14 internal analytics teams and 600+ users.Closely collaborate with key stakeholders from business data science teams and IT data engineering teams to enable them on the platform. Identify new requirements, analyze platform suitability, propose best practices and existing solutions through demos…Act as a hands-on data engineer to onboard new use cases and optimize existing ones, build production ready ETL pipelines, ML/AI use cases and reporting solutions.Implement new infrastructure components with Infrastructure as code (IaC), as well as creating templates to ensure best practices and standardization among analytics teams.What You Bring4+ years of practical experience building production data pipelines, data modeling and BI tools in the cloud.Experience with Lakehouse architecture, preferably Databricks, with a strong knowledge of Spark and Open Table formats (Delta and/or Iceberg).Proficiency with Python (PySpark) and SQL with a solid understanding of software development and automation concepts like CI/CD to build production data and ML pipelines (DataOps/MLOps).Basic knowledge of cloud foundation services (IAM, networking, storage…), cloud costs management (FinOps) as well as tools to manage cloud infrastructure with IaC (Terraform/OpenTofu, Pulumi, bash scripting…) on Microsoft Azure (our primary cloud service provider) and/or Amazon Web Services, Google Cloud Platform.Growth mindset and a very proactive attitude for continuous learning and development.Good presentation and communication skills. Fluency in written and spoken English.If you have any questions,check out ourFAQ pageor callYuliya Stoykoat*******.For this vacancy we only accept direct applications.Diversity is important to us. Therefore, we are looking to receiving applications regardless of any personal background.

Requirements

4+ years of practical experience building production data pipelines, data modeling and BI tools in the cloud. Experience with Lakehouse architecture, preferably Databricks, with a strong knowledge of Spark and Open Table formats (Delta and/or Iceberg). Proficiency with Python (PySpark) and SQL with a solid understanding of software development and automation concepts like CI/CD to build production data and ML pipelines (DataOps/MLOps). Basic knowledge of cloud foundation services (IAM, networking, storage…), cloud costs management (FinOps) as well as tools to manage cloud infrastructure with IaC (Terraform/OpenTofu, Pulumi, bash scripting…) on Microsoft Azure (our primary cloud service provider) and/or Amazon Web Services, Google Cloud Platform. Growth mindset and a very proactive attitude for continuous learning and development. Good presentation and communication skills. Fluency in written and spoken English.

About the company

Málaga, España

BME - Bolsas y Mercados Españoles - drives the transformation of financial markets and belongs to SIX, the third largest exchange group in Europe. What sets us apart drives us ahead: between local roots and global relevance, we are a unique blend of tradition and future, of foundation and growth. We value bright minds and inspire them to grow with their ideas. Come and shape the future of finance with us.