Data Engineer

CBS Butler Limited
Luton, United Kingdom
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 72K

Job location

Luton, United Kingdom

Tech stack

Java
Airflow
Big Data
Continuous Integration
Information Engineering
Data Governance
Data Infrastructure
ETL
Data Security
Data Warehousing
Database Design
Hive
Python
NoSQL
Raw Data
Standard Sql
DataOps
SQL Databases
Data Streaming
Unstructured Data
Workflow Management Systems
Data Ingestion
Spark
SC Clearance
Containerization
Data Management
Stream Processing
Data Pipelines

Job description

  • Design, develop, deploy, and support scalable data infrastructure, pipelines, and architectures
  • Orchestrate ingestion and storage of raw data into structured and unstructured data solutions
  • Implement reliable, automated, and well-tested data ingestion and processing workflows
  • Build and maintain batch and real-time data processing systems
  • Manage and optimise performance, reliability, scalability, and security of data platforms
  • Support data governance, quality, and compliance requirements
  • Prepare data pipelines for descriptive, predictive, and prescriptive analytics
  • Collaborate closely with data scientists, architects, IT teams, and business stakeholders
  • Identify opportunities for new data acquisition and improved data utilisation
  • Monitor, manage, and enhance data quality and reliability through automated tooling

Technologies:

  • Airflow
  • Big Data
  • CI/CD
  • ETL
  • Hive
  • IBM
  • Support
  • Java
  • NoSQL
  • Python
  • SQL
  • Security
  • Spark, We are a dynamic company located in either Edinburgh or Luton, offering a hybrid or onsite work environment as required. We are seeking an experienced Data Engineer to join our team on a contract basis, and we offer a competitive rate of £500 - £600 per day inside IR35. Our team is focused on designing, building, deploying, and maintaining robust data platforms and pipelines in a secure environment, ensuring that our data operations infrastructure is optimised for performance, reliability, scalability, and security.

Requirements

  • Active SC Clearance (mandatory)
  • Strong experience designing and maintaining data pipelines, data warehouses, and data platforms
  • Solid knowledge of DataOps practices, including CI/CD, containerisation, and workflow orchestration
  • Hands-on experience with ETL/ELT frameworks and big data tools (e.g. Spark, Airflow, Hive)
  • Proficiency in programming languages such as Python, Java, and SQL
  • Experience with SQL and NoSQL database design and optimisation
  • Strong understanding of batch and streaming data processing
  • Degree in a STEM-related field; Masters degree desirable
  • Data engineering certifications (e.g. IBM Certified Data Engineer) are advantageous

Apply for this position