Lead Software Engineer - (Data Platforms)

Fimador
Peterborough, United Kingdom
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Peterborough, United Kingdom

Tech stack

Java
Artificial Intelligence
Software as a Service
Code Review
Databases
Continuous Integration
Data Cleansing
Distributed Systems
Data Intelligence
Python
Spark
PySpark
Kafka
Data Management
Data Lakehouse
Amazon Web Services (AWS)
Data Pipelines
Databricks

Job description

Key Responsibilities:Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark).Ensure performance, scalability, and compliance.Collaborate on requirements, design, and backlog refinement.Promote engineering best practices including CI/CD, code reviews, and testing.Research and introduce new tools, technologies, and methodologies.

Requirements

Ideal experience:Experience with efficient, reliable data pipelines that improve time-to-insight.Knowledge of secure, auditable, and compliant data workflows.Know how on optimising performance and reducing costs through Spark and Databricks tuning.Be able to create reusable, well-documented tools enabling collaboration across teams.A culture of engineering excellence driven by mentoring and high-quality practices. Preferred ExperienceDatabricks in a SaaS environment, Spark, Python, and database technologies.Event-driven and distributed systems (Kafka, AWS SNS/SQS, Java, Python).Data Governance, Data Lakehouse/Data Intelligence platforms.AI software delivery and AI data preparation.

About the company

Fimador is currently recruiting for a Senior Software Engineer to lead a team developing cutting-edge data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices.

Apply for this position