Cloud Data Engineer

Six
Madrid, Spain
15 days ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
4 years minimum
Working hours
Regular working hours
Languages
English

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Bash Shell Cloud Computing Cloud Database Continuous Integration Data Architecture Information Engineering Extract Transform Load (ETL) Identity and Access Management Python (Programming Language)
+13 more
Operational Databases Cloud Services DataOps Software Engineering SQL Databases Pulumi Google Cloud Apache Spark Infrastructure as Code (IaC) Pyspark Machine Learning Operations Terraform Databricks

Job description

What You Will Do Be part of an international team that designs and maintains a mature cloud native data science platform, currently serving more than 14 internal analytics teams and 600+ users.Closely collaborate with key stakeholders from business data science teams and IT data engineering teams to enable them on the platform.Identify new requirements, analyze platform suitability, propose best practices and existing solutions through demos…Act as a hands-on data engineer to onboard new use cases and optimize existing ones, build production ready ETL pipelines, ML/AI use cases and reporting solutions.Implement new infrastructure components with Infrastructure as code (IaC), as well as creating templates to ensure best practices and standardization among analytics teams.What You Bring 4+ years of practical experience building production data pipelines, data modeling and BI tools in the cloud.Experience with Lakehouse architecture, preferably Databricks, with a strong knowledge of Spark and Open Table formats (Delta and/or Iceberg).Proficiency with Python (PySpark) and SQL with a solid understanding of software development and automation concepts like CI/CD to build production data and ML pipelines (DataOps/MLOps).Basic knowledge of cloud foundation services (IAM, networking, storage…), cloud costs management (FinOps) as well as tools to manage cloud infrastructure with IaC (Terraform/OpenTofu, Pulumi, bash scripting…) on Microsoft Azure (our primary cloud service provider) and/or Amazon Web Services, Google Cloud Platform.Growth mindset and a very proactive attitude for continuous learning and development.Good presentation and communication skills.Fluency in written and spoken English.If you have any questions, check out our or call Yuliya Stoyko at.For this vacancy we only accept direct applications.Diversity is important to us.Therefore, we are looking to receiving applications regardless of any personal background.What We Offer Flexible Work Models We trust our employees and offer a work environment that is well-balanced, productive and fosters success.Personal Development You will benefit from a culture of continuous learning and feedback.Your personal growth is supported through an extensive learning offering.Agile Working Methods Whether through scrum or design thinking, we solve exciting tasks together in teams.

Requirements

What You Bring 4+ years of practical experience building production data pipelines, data modeling and BI tools in the cloud. Experience with Lakehouse architecture, preferably Databricks, with a strong knowledge of Spark and Open Table formats (Delta and/or Iceberg). Proficiency with Python (PySpark) and SQL with a solid understanding of software development and automation concepts like CI/CD to build production data and ML pipelines (DataOps/MLOps). Basic knowledge of cloud foundation services (IAM, networking, storage…), cloud costs management (FinOps) as well as tools to manage cloud infrastructure with IaC (Terraform/OpenTofu, Pulumi, bash scripting…) on Microsoft Azure (our primary cloud service provider) and/or Amazon Web Services, Google Cloud Platform. Growth mindset and a very proactive attitude for continuous learning and development. Good presentation and communication skills. Fluency in written and spoken English.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:55 min

Contrasting Terraform with Pulumi and cloud-specific tools

Devlin Duldulao · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

Videos

See all

Related articles

See all