Data Integration Engineer

Halliburton
Abingdon, United Kingdom
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Junior

Job location

Abingdon, United Kingdom

Tech stack

Java
Geographic Information Systems
API
Agile Methodologies
Amazon Web Services (AWS)
ArcGIS (Software)
Azure
Software as a Service
Cloud Computing
Cloud Database
Databases
Data Governance
Data Integration
ETL
Data Virtualization
Data Visualization
Relational Databases
GIS Applications
Information Lifecycle Management
JSON
Python
Open Data Protocol
Powershell
Quantum GIS (QGIS)
Queueing Systems
Cloud Services
SQL Databases
Data Streaming
XML
Large Language Models
Gitlab
Integration Frameworks
Kafka
Spotfire
REST
Stream Processing
Data Pipelines

Job description

We are seeking a skilled and proactive Data Integration Engineer to join the Neftex Technical Services team. Reporting to the Team Lead the Data Integration Engineer will be responsible for designing, building, and maintaining robust data pipelines and integration frameworks that connect diverse systems including LLMs and a proprietary Data Integration solution.

Successful candidates will be evidently enthusiastic and motivated people who we can train up in our processes and ultimately play a key role in quality assurance initiatives across different stakeholder groups., * Design and implement scalable data integration solutions using ETL/ELT tools and APIs

  • Develop and maintain data pipelines that include Large Language Models (LLMs)
  • Build solutions that include cloud and on-premises environments
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements
  • Integrate data from various sources including databases, SaaS platforms, APIs, and flat files
  • Monitor and optimize data flows for performance, reliability, and cost-efficiency
  • Ensure data quality, consistency, and governance across integrated systems
  • Automate data workflows and support real-time data streaming
  • Document integration processes and maintain technical specification

Requirements

  • 3+ years' experience working with database and related tools
  • Strong proficiency with data virtualisation platforms and tools such as Teiid or similar
  • Solid understanding of SQL, relational databases, and data modelling
  • Experience with cloud platforms (AWS, Azure) and cloud-native data services
  • Familiarity with RESTful APIs, JSON, XML, OData, and message queues (Kafka)
  • Knowledge of data governance, security, and compliance best practices

Preferred Skills:

  • Experience with cloud-based database solutions.
  • Understanding of data lifecycle management and SOC2 security standards.
  • Familiarity with geoscience disciplines, geospatial data and GIS tools (e.g., ArcGIS, QGIS) is advantageous.
  • Scripting and automation (e.g., PowerShell, Python, Java).
  • Experience with Gitlab.
  • Knowledge of Spotfire data visualization platform or alternative dashboard solutions.
  • Awareness of Agile delivery methodologies.

Minimum Qualifications: Minimum qualifications may be acquired through technical schools or equivalent related experience. Candidates having qualifications that exceed the minimum job requirements will receive consideration for higher level roles given (1) their experience, (2) additional job requirements, and/or (3) business needs. Depending on education, experience, and skill level, a variety of job opportunities might be available from the Data Integration Engineer (Senior - Principal)

Apply for this position