Data Engineer

Searchability
Cardiff, United Kingdom
2 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 53K

Job location

Cardiff, United Kingdom

Tech stack

Java
Apache HTTP Server
Databases
Data Governance
Data Integration
Data Integrity
ETL
Data Stores
Data Systems
Embedded Software
Groovy
Python
Network Security
MongoDB
NoSQL
Scrum
Software Engineering
SQL Databases
Test Driven Development
Data Strategy
Kafka
Apache Nifi
Data Pipelines

Job description

  • Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.G., NiFi).
  • Ensure data consistency, quality, and security across all processes.
  • Create and maintain database schemas and data models.
  • Integrate and enrich data from diverse sources, maintaining data integrity.
  • Maintain and enhance existing architectural components such as Data Ingest and Data Stores.
  • Troubleshoot and diagnose issues within integrated (enriched) data systems.
  • Collaborate with the scrum team to decompose user requirements into epics and stories.
  • Write clean, secure, and reusable code following a test-driven development approach.
  • Monitor system performance and implement updates to maintain optimal operation.

The Data Engineer Should Have:

  • Active eDV clearance (West)
  • Willingness to work full-time on-site in Gloucester when required.

Required technical experience in the following:

  • Apache Kafka
  • Apache NiFI
  • SQL and noSQL databases (e.G. MongoDB)
  • ETL processing languages such as Groovy, Python or Java, You've spent years ensuring quality in assessment practice. Now you want to bring that expertise somewhere it genuinely matters - where quality isn't just a compliance exercise, but the backbone of real learner outcomes. This is a flexible, contract role estimated at 2-3..., Job title: Senior Embedded Software EngineerLocation: Maidenhead, Berkshire Salary Range: Negotiable About The Role: As a Senior Embedded Software Engineer, you will be reporting to the Software Engineering Manager as an embedded systems developer. Responsible for..., Position Title: Technical Solution Engineer Location: London, Cheltenham or Manchester - Hybrid Role Purpose The Technical Solutions Engineer is an entry-level technical role within NCC Group's Sales Engineering & Field Strategy team, supporting the design and delivery...

Requirements

  • Must hold active Enhanced DV Clearance (West)
  • Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus
  • Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, DATA ENGINEER / DATA ENGINEERING / DEFENCE / NATIONAL SECURITY / DATA STRATEGY / DATA PIPELINES / DATA GOVERNANCE / SQL / NOSQL / APACHE / NIFI / KAFKA / ETL / GLOUCESTER / DV / SECURITY CLEARED / DV CLEARANCE

Benefits & conditions

New Permanent Opportunity for an Enhanced DV Cleared Data Scientist / AI Engineer in Cheltenham. - Must have active enhanced DV (West) Clearance - Junior to Lead levels available - £45k to £95k DoE plus 15% clearance bonus - Must be willing to be full-time on-site in..., Electrical Design EngineerInitial 12 Month Contract2-3 days per week on siteSamlesbury, Lancashire£47.12 Per Hour (Umbrella Rate - Inside IR35)The Role* Working closely with other engineering disciplines and functions, supplier and customer areas, fostering a team-working...

About the company

Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth., Newton Blue £80,000 Were working with a Bristol based tech co. a leading worldwide supplier of software to health insurers, with an extensive platform consisting of Core back office automation, Open API and integration suite and Digital solutions serving the insurance value chain. Currently..., Ready to shape the future of work? At Genpact, we don't just adapt to change-we drive it. AI and digital innovation are redefining industries, and we're leading the charge. Genpact's AI Gigafactory, our industry-first accelerator, is an example of how we're scaling..., Product Engineer (Mid-level or Senior) Full-time | Hybrid in-office Cardiff, London, or remote UK Who We Are iAltA Holdings is a next-generation financial services ecosystem purpose-built to power the future of private markets. Our portfolio of companies spans data..., Who We Are Suntory is a fast moving, agile and entrepreneurial business that is home to some of the nations most loved brands. The Suntory Group is one of the largest soft drinks companies and among the world's leading consumer products companies. We offer a uniquely..., Software Engineer Gloucester, Gloucestershire £43-53k p/a with BUPA, bonus and full benefits 4 Day Work Week options Lockheed Martin Rotary and Mission Systems (RMS) provides systems engineering, software development, training solutions and complex program management...

Apply for this position