Big Data Developer

Talan SAS
Municipality of Madrid, Spain
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Remote
Municipality of Madrid, Spain

Tech stack

Java
Agile Methodologies
Artificial Intelligence
Data analysis
Big Data
Continuous Integration
Information Engineering
ETL
Data Transformation
DevOps
Github
Hive
Python
Cisco Nexus Switches
Cloudera
Software Engineering
SonarQube
SQL Databases
Qliksense
Spark
GIT
Ansi Sql
Information Technology
Data Management
Software Version Control
Data Pipelines
Amazon Web Services (AWS)
Databricks
Programming Languages

Job description

We are looking for a Mid-Level Big Data Developer to join the Client Contribution Platform team. In this role, you will be responsible for developing, maintaining, and optimizing large-scale data processing solutions, ensuring high performance, scalability, and data quality across the platform.

You will work closely with both technical and business stakeholders in an Agile environment, contributing to the design and implementation of modern data engineering solutions while continuously improving existing processes., * Design, develop, and maintain ETL and data transformation processes.

  • Build, optimize, and support Spark-based data pipelines.
  • Develop scalable data processing solutions in a Big Data environment.
  • Integrate data from multiple sources while ensuring data quality and consistency.
  • Analyze, troubleshoot, and resolve data-related issues.
  • Optimize data performance and processing efficiency.
  • Collaborate with cross-functional teams to gather and refine business requirements.
  • Participate in Agile ceremonies and contribute to continuous improvement initiatives.
  • Follow DevOps and CI/CD best practices throughout the development lifecycle., * Permanent, full-time contract with career development opportunities.
  • Chance to work in a challenging, multicultural environment with international projects.
  • Exposure to large-scale financial IT systems and cross-country operations.
  • Training opportunities to develop new skills in finance, technology, and data management.

Requirements

  • 3+ years of experience in software development and data engineering.
  • Strong SQL knowledge (ANSI SQL, Hive SQL, Spark SQL, or equivalent).
  • Hands-on experience with Apache Spark and at least one of the following programming languages:
  • Scala
  • Python
  • Java
  • Experience working with Spark-based platforms such as:
  • Azure Databricks
  • Amazon EMR
  • Cloudera
  • Apache Hive
  • or similar Big Data environments.
  • Experience with Qlik Sense reporting and dashboard development.
  • Familiarity with Agile methodologies and DevOps practices.
  • Experience with version control and CI/CD tools such as:
  • Git
  • GitHub
  • SonarQube
  • Nexus
  • Strong analytical and problem-solving skills.
  • Ability to work collaboratively within a multidisciplinary team.
  • Ability to understand, analyze, and improve business and technical requirements.
  • English level B2+ or above., Nice to Have
  • Interest or experience in using AI-assisted development tools.
  • Knowledge of AI-driven approaches for data engineering, automation, and analytics.
  • Experience with process optimization through AI technologies.

About the company

Join Us! Why Talan? For the 4th consecutive year, Talan Spain has been recognized as a Great Place to Work! This year, we're also celebrating our 2nd certification in Poland, a significant milestone since opening our office there. Talan is an international advisory group specializing in innovation and transformation through technology, with 5,000 employees and an annual turnover of 600M€. We offer our customers a continuum of services to support them at each key stage of their organization's transformation, with four main activities: * CONSULTING in Management and Innovation: Supporting business, managerial, cultural, and technological transformations. * DATA & TECHNOLOGY: Implementing major transformation projects. * CLOUD & APPLICATION SERVICES: Building or integrating software solutions. * SERVICE CENTERS of EXCELLENCE: Providing technology, innovation, agility, sustainability of skills, and cost optimization. Talan accelerates its clients' transformation through innovation and technology. By understanding their challenges and supporting them with technology, innovation, and data, we enable them to be more efficient and resilient.

Apply for this position