Data Integration Engineer
Role details
Job location
Tech stack
Job description
We are looking for the right people - people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world's largest providers of products and services to the global energy industry., We are seeking a skilled and proactive Data Integration Engineer to join the Neftex Technical Services team. Reporting to the Team Lead the Data Integration Engineer will be responsible for designing, building, and maintaining robust data pipelines and integration frameworks that connect diverse systems including LLMs and a proprietary Data Integration solution.
Successful candidates will be evidently enthusiastic and motivated people who we can train up in our processes and ultimately play a key role in quality assurance initiatives across different stakeholder groups., * Design and implement scalable data integration solutions using ETL/ELT tools and APIs
- Develop and maintain data pipelines that include Large Language Models (LLMs)
- Build solutions that include cloud and on-premises environments
- Collaborate with data architects, analysts, and business stakeholders to understand data requirements
- Integrate data from various sources including databases, SaaS platforms, APIs, and flat files
- Monitor and optimize data flows for performance, reliability, and cost-efficiency
- Ensure data quality, consistency, and governance across integrated systems
- Automate data workflows and support real-time data streaming
- Document integration processes and maintain technical specification
Requirements
- 3+ years' experience working with database and related tools
- Strong proficiency with data virtualisation platforms and tools such as Teiid or similar
- Solid understanding of SQL, relational databases, and data modelling
- Experience with cloud platforms (AWS, Azure) and cloud-native data services
- Familiarity with RESTful APIs, JSON, XML, OData, and message queues (Kafka)
- Knowledge of data governance, security, and compliance best practices
Preferred Skills:
- Experience with cloud-based database solutions.
- Understanding of data lifecycle management and SOC2 security standards.
- Familiarity with geoscience disciplines, geospatial data and GIS tools (e.g., ArcGIS, QGIS) is advantageous.
- Scripting and automation (e.g., PowerShell, Python, Java).
- Experience with Gitlab.
- Knowledge of Spotfire data visualization platform or alternative dashboard solutions.
- Awareness of Agile delivery methodologies.
Benefits & conditions
Compensation is competitive and commensurate with experience.