Big Data Developer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+21 more
Job description
We are looking for a Mid-Level Big Data Developer to join the Client Contribution Platform team.In this role, you will be responsible for developing, maintaining, and optimizing large-scale data processing solutions, ensuring high performance, scalability, and data quality across the platform.You will work closely with both technical and business stakeholders in an Agile environment, contributing to the design and implementation of modern data engineering solutions while continuously improving existing processes.Key ResponsibilitiesDesign, develop, and maintain ETL and data transformation processes.Build, optimize, and support Spark-based data pipelines.Develop scalable data processing solutions in a Big Data environment.Integrate data from multiple sources while ensuring data quality and consistency.Analyze, troubleshoot, and resolve data-related issues.Optimize data performance and processing efficiency.Collaborate with cross-functional teams to gather and refine business requirements.Participate in Agile ceremonies and contribute to continuous improvement initiatives.Follow DevOps and CI/CD best practices throughout the development lifecycle.Required Skills & Experience3+ years of experience in software development and data engineering.Strong SQL knowledge (ANSI SQL, Hive SQL, Spark SQL, or equivalent).Hands?on experience with Apache Spark and at least one of the following programming languages:ScalaPythonJavaExperience working with Spark?based platforms such as:Azure DatabricksAmazon EMRClouderaApache Hiveor similar Big Data environments.Experience with Qlik Sense reporting and dashboard development.Familiarity with Agile methodologies and DevOps practices.Experience with version control and CI/CD tools such as:GitGitHubSonarQubeNexusStrong analytical and problem?solving skills.Ability to work collaboratively within a multidisciplinary team.Ability to understand, analyze, and improve business and technical requirements.English level B2+ or above.Nice to HaveInterest or experience in using AI?assisted development tools.Knowledge of AI?driven approaches for data engineering, automation, and analytics.Experience with process optimization through AI technologies.Additional InformationPermanent, full?time contract with career development opportunities.Chance to work in a challenging, multicultural environment with international projects.Exposure to large?scale financial IT systems and cross?country operations.Training opportunities to develop new skills in finance, technology, and data management.Talan Spain’s commitment to non?discrimination based on gender, race, ideology, or any other reason, in accordance with the company’s “Equality Plan” and the current regulations on gender equality between women and men (Royal Decree?Law **).#J-*****-Ljbffr
Requirements
3+ years of experience in software development and data engineering. Strong SQL knowledge (ANSI SQL, Hive SQL, Spark SQL, or equivalent). Hands?on experience with Apache Spark and at least one of the following programming languages: Scala Python Java Experience working with Spark?based platforms such as: Azure Databricks Amazon EMR Cloudera Apache Hive or similar Big Data environments. Experience with Qlik Sense reporting and dashboard development. Familiarity with Agile methodologies and DevOps practices. Experience with version control and CI/CD tools such as: Git GitHub SonarQube Nexus Strong analytical and problem?solving skills. Ability to work collaboratively within a multidisciplinary team. Ability to understand, analyze, and improve business and technical requirements. English level B2+ or above. Nice to Have Interest or experience in using AI?assisted development tools. Knowledge of AI?driven approaches for data engineering, automation, and analytics. Experience with process optimization through AI technologies.
Benefits & conditions
Permanent, full?time contract with career development opportunities. Chance to work in a challenging, multicultural environment with international projects. Exposure to large?scale financial IT systems and cross?country operations. Training opportunities to develop new skills in finance, technology, and data management. Talan Spain’s commitment to non?discrimination based on gender, race, ideology, or any other reason, in accordance with the company’s “Equality Plan” and the current regulations on gender equality between women and men (Royal Decree?Law **). #J-*****-Ljbffr
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
Data Engineer Salary UK
The Most Popular IT Jobs on the Market