Software Engineer - Data

Lawrence Harvey

Barcelona, Spain

about 1 month ago

Apply on www.buscojobs.com.es

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.buscojobs.com.es

Tech stack

Java (Programming Language) Airflow Microsoft Azure BigQuery Cloud Computing Cloud Storage Continuous Integration Information Engineering Data Governance Data Infrastructure Data Systems DevOps

+20 more

Distributed Computing Environment Distributed Systems Python (Programming Language) Machine Learning Role-Based Access Control SonarQube SQL Databases Data Streaming Google Cloud Cloud Platform System Apache Spark Gitlab Kubernetes Apache Flink Apache Kafka Data Management Video Streaming Confluent Databricks Artifactory

Job description

We are looking for one of our client for a talented Data Engineer is looking for a Data Engineer with hands-on experience in modern data engineering, distributed systems, lakehouse architectures, and cloud environments.This is a hybrid role in Barcelona, working on scalable data platforms and modern data solutions.Your ResponsibilitiesDevelop and operate robust batch and streaming data pipelines for reporting, analytics, and machine learningDesign and optimize scalable solutions using distributed systems and lakehouse architecturesEnsure data quality, security, governance, and scalability across data platformsMonitor and troubleshoot data infrastructure and contribute to CI/CD and DevOps practicesWork in agile, interdisciplinary teams with Data Scientists, Data Engineers, Product Owners, and specialist departmentsYour ProfileHands-on experience in Data Engineering, distributed data processing, and cloud environmentsStrong experience with Apache Spark, Databricks, Apache Airflow, and KubernetesExperience with Python, Scala, or Java and SQLExperience with batch and streaming technologies, ideally Kafka, Flink, or ConfluentKnowledge of GCP, Azure, BigQuery, GCS, Azure Blob Storage, or Databricks Unity CatalogUnderstanding of RBAC/CBAC, data governance, CI/CD, and DevOpsExperience with tools such as Azure DevOps, GitLab, JFrog Artifactory, SonarQube, or Snyk is a plusAnalytical mindset, independence, and a hands-on approachLocation:BarcelonaWorking model:Hybrid

Requirements

Hands-on experience in Data Engineering, distributed data processing, and cloud environments Strong experience with Apache Spark, Databricks, Apache Airflow, and Kubernetes Experience with Python, Scala, or Java and SQL Experience with batch and streaming technologies, ideally Kafka, Flink, or Confluent Knowledge of GCP, Azure, BigQuery, GCS, Azure Blob Storage, or Databricks Unity Catalog Understanding of RBAC/CBAC, data governance, CI/CD, and DevOps Experience with tools such as Azure DevOps, GitLab, JFrog Artifactory, SonarQube, or Snyk is a plus Analytical mindset, independence, and a hands-on approach Location:Barcelona