Senior Big Data Engineer (Spark/Scala/Java)

Luxoft
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
€ 77K

Job location

Tech stack

Java
Agile Methodologies
Azure
Big Data
Computer Programming
Data Structures
Software Design Documents
Information Model
Python
Platform as a Service (PAAS)
Spark
Gitlab
Containerization
Kubernetes
Data Lineage
Build Tools
Terraform
Databricks

Job description

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:

  • Scalable cost-efficient infrastructure, using cloud PaaS components.
  • Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
  • Shared across Front Office, Finance and Risk, improving regulatory compliance.
  • One-Platform / One-Experience -fast to train, easy to operate, retaining talent.

The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

  • Work with multiple federated teams to enable them to build Big Data solutions
  • Manage the ACQA Databricks platform - provide monitoring and other tooling
  • Provide best practices for runtime upgrades

MUST

  • Development of big data technologies like Apache Spark and Azure Databricks
  • Programming complex production systems in Java and Scala
  • Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
  • Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
  • Experience with containerisation in development, build, and runtime environments, including experience with Kubernetes

Requirements

  • Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)
  • Python experience
  • Testing and instrumentation practices, observability and alerting tooling
  • Understanding of information modelling, data structures and algorithms
  • Technical architecture and low-level design
  • Agile development and planning practices
  • Ability to collaborate effectively in a large global team and influence key architectural decisions

About the company

Luxoft, a DXC Technology Company, (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Luxoft uses technology to enable business transformation, enhance customer experiences, and boost operational efficiency through its strategy, consulting, and engineering services. Luxoft combines a unique blend of engineering excellence and deep industry expertise, specializing in automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

Apply for this position