Data Platform DevOps Engineer

Comunidad de Madrid

Madrid, Spain

3 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.jobleads.com

Tech stack

Airflow Data Analysis Bash Shell Big Data Information Engineering Data Governance Data Virtualization Apache Hadoop Python (Programming Language) Ansible SQL Databases Parquet

+13 more

Data Processing Scripting Grafana Apache Spark Git Data Lakes Deployment Automation Data Management Presto Data Lakehouse Terraform Dynatrace Elk Stack

Job description

You will be part of an international team responsible for ensuring the availability, performance, scalability, and optimization of a data virtualization platform used by various engineering and analytics teams.

You will contribute to process automation, environment management, platform monitoring, and the continuous improvement of Data Lakehouse architectures.

What will you do?

Administer and monitor data platforms in production environments.
Manage incidents and provide advanced technical support (L2/L3).
Automate deployments and processes through CI/CD pipelines.
Optimize platform performance and data query execution.
Design and implement observability and monitoring solutions.
Participate in the integration and evolution of Data Lake and Data Lakehouse ecosystems.
Collaborate with Data Engineering, Analytics, and Architecture teams.
Contribute to cost optimization (FinOps) initiatives and continuous improvement.

Requirements

Required tools and technologies:

Dremio (or equivalent technologies such as Presto or Trino).
Scripting languages (Python, Bash).
SQL / Data processing (query execution analysis).
Data Lake concepts (Parquet, Iceberg, Polaris, Data Governance).
Data Lakehouse / Big Data.
Apache Spark (highly desirable).
Hadoop.
Airflow (orchestration).
Observability tools.
Grafana.
ELK Stack.
Dynatrace.
Infrastructure & DevOps.
Terraform.
Ansible.
Git.

Requirements

We are seeking professionals with experience in DevOps environments and data platforms, interested in working with Big Data technologies, automation, observability, and scalable architectures.

Benefits & conditions

Permanent contract and long-term project.
Innovative and technologically challenging projects.
Professional development in an international environment.
Flexible compensation package: private health insurance, meal vouchers, and childcare vouchers.
Continuous training and access to professional certifications.
Corporate discount platform and employee benefits program.

full_time