Scala Engineer/Data Engineer
Role details
Job location
Tech stack
Job description
The Client is seeking a Software/Data Engineer to help develop and maintain both the Attribute and Insights Data Products. We support services that run both on the Multi-Channel Digital Tax Platform (MDTP) and the Customer Insights Platform (CIP).
The Software Engineer will be part of a vibrant multi-disciplinary team. They should be comfortable around Back End coding languages (Scala/Python), Front End languages (HTML/CSS/JS), development frameworks (Play/Spark), Agile Methodologies/Practices (Kanban/Scrum/Sprint), Operational Support (Kibana/Grafana), CI/CD (Jenkins/Airflow), RESTful APIs, Databases (MongoDB, Postgres, Hudi), AWS (Aurora RDS, S3, ECS, Secrets Manager), Infrastructure as code (Terraform) and third-party libraries.
Common tasks including to:
Participate in the design and creation of scalable software
Design and develop clean functioning, testable code on the frontends and backends, write effective APIs, develop and manage well-functioning databases and applications with security and data protection settings
Collaborate with the CIR product owner, business analyst, data engineers and the wider CIP teams to ideate software solutions
Peer reviewing pull requests
Testing and fixing bugs or other coding issues
Set up, maintain and improve continuous integration
Support live services with troubleshooting and monitoring
Write technical documentation
Requirements
Knowledge of Front End languages (HTML, CSS, JavaScript)
Knowledge of multiple Back End languages (eg Scala, Java, Python) and libraries
Familiarity with databases (eg Postgres, MongoDB, Splunk)
Familiarity with big data tools (Spark, Presto, AWS EMR)
Proven experience as a Full Stack Developer or similar role
Experience coding in continuous integration context
AWS suite experience
Understands the importance of testing and automation
Working in a lean, agile environment
Working in a you build it you run it team
Experience coding in continuous integration context
Excellent communication
Team player
Great attention to detail
An analytical mind
Skills & technologies
Essential:
Scala/Java
Play Framework (or other MVC/Rest API frameworks)
SQL DB (eg Aurora, Postgres)
NoSQL DB (eg MongoDB)
Linux/Unix
AWS (S3, ECS, Lamda, etc.)
HTML/CSS/JavaScript
Terraform
SBT
Continuous Integration (Jenkins)
Agile methodologies
Desirable:
Python
Airflow
Docker