Big Data Engineer - Data Lake (ODS)

Banco Santander, S.A.

1 month ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Job location

Tech stack

Amazon Web Services (AWS)

Apache HTTP Server

JIRA

Big Data

Cloud Computing

Information Systems

Continuous Integration

Data Integration

Data Warehousing

Database Storage Structures

Software Design Patterns

DevOps

Amazon DynamoDB

Elasticsearch

Hadoop

Hive

Identity and Access Management

PostgreSQL

MySQL

Cisco Nexus Switches

NoSQL

Redis

Scala

SONAR (Symantec)

SQL Databases

Data Streaming

Test Driven Development

Spark

GIT

Cloudformation

Data Lake

Information Technology

Apache Flink

Kafka

Spark Streaming

Data Management

Splunk

Jenkins

Job description

Design and implement production big data environments using modern technologies.

Requirements

Build, validate, and optimize large-scale, big data solutions in heterogeneous data environments.
Develop and manage ETLs in batch (Spark and Scala), and streaming (Apache Flink). To be successful in the role you must have
- years of experience working with Scala, Spark, software design patterns, and TDD.
Experience working with big data - Spark is a must - Hadoop, Hive, and/or Kafka would be a plus.
Experience with different database structures, including SQL (Postgres, MySQL), and NOSQL (DynamoDB, DocumentDB, Redis, Elasticsearch).
Experience and expertise across data integration and data management with high data volumes.
Experience with Cloud ecosystems, AWS ecosystem (EMR, EC, IAM, GLUE, ATHENA, S, CloudFormation, LakeFormation, Redshift, DynamoDB, RDS, ECS & ECR) would be a great plus!
Experience working in agile continuous integration/DevOps paradigm and tool set (Git, Jenkins, Sonar, Nexus, Jira, and Splunk).
Bachelor's Degree in Computer Science, Information Systems, Mathematics, or other STEM, and related fields, or equivalent work experience.
Professional working proficiency in English. Nice to have
Experience with data warehousing, apache iceberg, and visualisation tools.
Experience with NRT applications: Apache Flink, spark streaming.

Benefits & conditions

Joining a dynamic and agile environment, with plenty of opportunities to grow, and have impact!
Working in a start-up mode with the support of Santander Group in a growing and expansion project.
Competitive remuneration and attractive benefits package.
Collaboration in international projects with peers from all around the globe.
Excellent work environment, social clubs, and frequent events. Would you like to grow with us? Join our team! Our culture sets us apart from the rest; social and diversity clubs are part of our essence and day-to-day culture. OBTECH OBDATA

About the company

Open Digital Services is the software development company of Santander Group powering the next generation of banks by creating innovative banking products and implementing them in collaboration with Santander Group Affiliates. Santander Group is one of the world's largest financial institutions and the Eurozone's leader, we're committed to being the best Digital Bank with Branches in the industry. Our mission at ODS is to design and support an advanced digital and omnichannel platform, ensuring the best customer experience using cutting-edge technology. Openbank, our flagship partner, is where we develop our most advanced concepts first. Be part of our Best-in-Class team and help us create unique value for our customers! Join us to tackle exciting tech challenges in an agile environment, benefiting from learning, growth, and local and international career opportunities in a modern, diverse setting.