Data Integration Engineer

Halliburton

Milton, UK

2 months ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

3 years minimum

Working hours

Regular working hours

Job source

miltonpark.co.uk

Tech stack

Java (Programming Language) Geographic Information Systems Application Programming Interfaces (APIs) Agile Methodology Amazon Web Services ArcGIS (Software) Microsoft Azure Software as a Service Cloud Computing Cloud Database Databases Data Governance

+25 more

Data Integration Extract Transform Load (ETL) Data Virtualization Data Visualization Relational Databases GIS Applications Information Lifecycle Management JSON Python (Programming Language) Open Data Protocol Windows PowerShell Quantum GIS (QGIS) Queueing Systems Cloud Services SQL Databases Data Streaming Extensible Markup Language (XML) Large Language Models Gitlab Integration Frameworks Apache Kafka Spotfire Restful APIs Stream Processing Data Pipelines

Job description

They are seeking a skilled and proactive Data Integration Engineer to join the Neftex Technical Services team. Reporting to the Team Lead the Data Integration Engineer will be responsible for designing, building, and maintaining robust data pipelines and integration frameworks that connect diverse systems including LLMs and a proprietary Data Integration solution.

Successful candidates will be evidently enthusiastic and motivated people who they can train up in their processes and ultimately play a key role in quality assurance initiatives across different stakeholder groups. Please note, although this is a hybrid position, you will be required to attend their Milton Park, Abingdon, Oxfordshire office a minimum of three days per week., * Design and implement scalable data integration solutions using ETL/ELT tools and APIs

Develop and maintain data pipelines that include Large Language Models (LLMs)
Build solutions that include cloud and on-premises environments
Collaborate with data architects, analysts, and business stakeholders to understand data requirements
Integrate data from various sources including databases, SaaS platforms, APIs, and flat files
Monitor and optimize data flows for performance, reliability, and cost-efficiency
Ensure data quality, consistency, and governance across integrated systems
Automate data workflows and support real-time data streaming
Document integration processes and maintain technical specification

Requirements

3+ years’ experience working with database and related tools
Strong proficiency with data virtualisation platforms and tools such as Teiid or similar
Solid understanding of SQL, relational databases, and data modelling
Experience with cloud platforms (AWS, Azure) and cloud-native data services
Familiarity with RESTful APIs, JSON, XML, OData, and message queues (Kafka)
Knowledge of data governance, security, and compliance best practices

Preferred Skills:

Experience with cloud-based database solutions.
Understanding of data lifecycle management and SOC2 security standards.
Familiarity with geoscience disciplines, geospatial data and GIS tools (e.g., ArcGIS, QGIS) is advantageous.
Scripting and automation (e.g., PowerShell, Python, Java).
Experience with Gitlab.
Knowledge of Spotfire data visualization platform or alternative dashboard solutions.
Awareness of Agile delivery methodologies.