Backend Developer - BI Spark/Scala
Role details
Job location
Tech stack
Job description
A leading consulting firm in Málaga, Spain is seeking a Senior Developer with expertise in data engineering and ETL development. The ideal candidate will have over 5 years of experience in building scalable data pipelines using technologies such as Apache Spark and Scala. The role involves designing and optimizing data solutions, ensuring data quality, and contributing to BI initiatives. This position offers a full-time contract, hybrid working conditions, and a range of benefits including private medical insurance, training, and career development., * Design, develop, and maintain ETL pipelines for data ingestion and transformation.
- Work with Spark and Scala to build scalable data processing solutions.
- Ensure data quality and validation across data pipelines.
- Develop and maintain data lake solutions using technologies such as Apache Hive and AWS.
- Implement unit testing and code quality checks using static code analysis tools.
Conhecimentos
ETL processes Apache Spark Scala SQL Data Lakes BI tools (Databricks, Power BI)
Ferramentas
Apache Hive AWS CI/CD tools Sonar Fortify Descrição da oferta de emprego Backend Developer - BI Spark/Scala (Relocation to Spain), We are looking for a Senior Developer with strong experience in data engineering and ETL development to join our team. The ideal candidate will have solid expertise in building and maintaining scalable data pipelines, working with big data technologies, and ensuring high-quality data processing within modern data platforms.
You will play a key role in the design, development, and optimization of data solutions, contributing to the development of robust data architectures and supporting business intelligence initiatives. Key Responsibilities
Design, develop, and maintain ETL pipelines for data ingestion and transformation.
Work with Spark and Scala to build scalable data processing solutions.
Design and implement data models to support analytics and reporting needs.
Develop and maintain data lake solutions using technologies such as Apache Hive, S3, and AWS.
Ensure data quality and validation across data pipelines and datasets.
Write and optimize complex SQL queries for data processing and analysis.
Work with relational database systems and ensure efficient data storage and retrieval.
Contribute to BI and analytics environments, integrating with tools such as Databricks, Power BI, or Starburst.
Implement unit testing and ensure code quality using static code analysis tools such as Sonar or Fortify.
Support and maintain CI/CD pipelines to ensure efficient and reliable software delivery.
Requirements
- 5+ years of experience implementing ETL processes.
- 3+ years of experience with Apache Spark.
- 3+ years of experience with Scala.
- 2+ years of experience working with BI tools (e.g., Databricks, Power BI, Starburst).
- Strong expertise in SQL., 5+ years of experience implementing ETL processes.
3+ years of experience with Apache Spark.
3+ years of experience with Scala.
2+ years of experience working with BI tools (e.g., Databricks, Power BI, Starburst).
Strong expertise in SQL.
Hands-on experience with Data Lakes (Apache Hive, S3, AWS).
Experience working with relational database systems.
Experience in data validation and quality assurance.
Experience with unit testing and static code analysis tools (Sonar and/or Fortify).
Benefits & conditions
- Full-time contract.
- Smart Office Pack so that you can work comfortably from home.
- Training and career development.
- Benefits and perks such as private medical insurance, life insurance.
- Possibility to be part of a multicultural team and work on international projects.
- This is a hybrid position based in Málaga, Spain.
- Possibility to manage work-permits.
If you are passionate about development & tech, we want to meet you!
Talan Spain is committed to non-discrimination based on gender, race, ideology, or any other grounds, in accordance with the company's Equality Plan and current regulations on gender equality between women and men (Royal Decree-Law 6/2019). Obtém a tua avaliação gratuita e confidencial do currículo