Databricks SME and AWS Data Engineer

Experis
Northampton, United Kingdom
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 125K

Job location

Northampton, United Kingdom

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Automation of Tests
Unit Testing
Software Quality
Computer Programming
Continuous Integration
Information Engineering
ETL
Distributed Systems
Fraud Prevention and Detection
Github
Python
PostgreSQL
Node.js
Secure Coding
Aerospike
Data Processing
Spark
Pytest
PySpark
Gitlab-ci
Integration Tests
Real Time Data
Kafka
Jenkins
Databricks

Job description

A key initiative involves migrating from Aerospike to Postgres and leveraging Databricks for back-testing fraud detection models. This role will contribute to the development and integration of Proof of Concepts (PoCs) from the detection backlog., * Collaborate with cross-functional teams to architect, design, develop and deliver PoCs related to fraud detection.

  • Lead the ETL & Data manipulation/engineering work on AWS.
  • Integrate Databricks-based back-testing into the fraud detection pipeline.
  • Work closely with architects and other developers to ensure seamless integration with existing systems.
  • Participate in weekly stand-up calls to demonstrate progress and align on deliverables.
  • Take ownership of tasks from the backlog, ensuring timely and high-quality delivery.

Requirements

  • Strong AWS Data Engineering expertise.
  • Proficiency in Kafka for real-time data streaming and integration.
  • Proficiency with Databricks for data processing and analytics.
  • Working knowledge of NodeJS would be an added advantage.
  • Solid programming skills in Python, PySpark, Spark.
  • Candidate must be adept at working with large-scale datasets, S3, Python, and data cataloguing tools. Familiarity with data engineering best practices is essential.
  • Performance and Code Quality - candidate should demonstrate a strong commitment to building high-performance, scalable, and resilient distributed systems, with an emphasis on clean, maintainable, and testable code.
  • CI/CD Proficiency - Hands-on experience with CI/CD pipelines and tools (e.g., Jenkins, GitHub Actions, GitLab CI, etc.) for automated build, test, and deployment processes.
  • Secure Development Practices - Awareness of secure coding standards, data protection principles, and experience working in regulated environments (especially relevant for fraud detection and financial services).
  • Testing Rigor - Strong understanding of unit testing, integration testing, and test automation frameworks (e.g., PyTest, etc.) to ensure code quality and reliability.
  • Familiarity with cloud-native development and CI/CD practices.
  • Agile mindset with a proactive, developer-driven approach to problem-solving., * A hands-on architect & developer with a strong sense of ownership and accountability.
  • Comfortable working in a collaborative, fast-paced environment.
  • Able to pick up tasks independently, contribute to design discussions, and deliver integrated solutions.
  • Strong communication skills to engage with both technical and non-technical stakeholders.

Benefits & conditions

Our role is to help our employees develop their careers through planning, coaching and training. We recognise everyone's contribution to our success and reward achievement at every level. Along with generous commission and bonus schemes, we offer a variety of on-the-spot rewards - from bottles of fizz, team nights out, and extra days off; to thrill-seeking experience days, social events and money off vouchers.

About the company

Experis delivers talent with the powerful combination of the technical skills you're after multiplied by the soft skills that are harder than ever to find. Offering IT resourcing, project solutions and managed services, we enable organisations to cultivate individuals and teams prepared for the digital age. Experis is part of the ManpowerGroup family of brands. ManpowerGroup is the world leader in innovative workforce solutions, connecting human potential to the power of business, We're Experis - the professional resourcing arm of ManpowerGroup and the largest IT recruiter in Europe; placing more than 44,000 experts into IT every day. We're a different kind of talent company with a reputation as the global leader in professional talent and workforce solutions. That's why over 80% of the Fortune Global 500 turns to us for the professional talent that will set their business apart., Unlocking talent is what we do. Through a structured career ladder which incorporates extensive training, coaching and mentoring opportunities, we'll empower you with the tools you need to achieve your personal best. We'll work with you to build a development path that's aligned to your aspirations - whether you're at the very start of your career or a seasoned professional. We offer one-day training courses, digital learning, leadership programmes and many other development initiatives.

Apply for this position