Data Integration Engineer
Role details
Job location
Tech stack
Job description
We are seeking a skilled and proactive Data Integration Engineer to join the Neftex Technical Services team. Reporting to the Team Lead the Data Integration Engineer will be responsible for designing, building, and maintaining robust data pipelines and integration frameworks that connect diverse systems including LLMs and a proprietary Data Integration solution.
Successful candidates will be evidently enthusiastic and motivated people who we can train up in our processes and ultimately play a key role in quality assurance initiatives across different stakeholder groups., * Design and implement scalable data integration solutions using ETL/ELT tools and APIs
- Develop and maintain data pipelines that include Large Language Models (LLMs)
- Build solutions that include cloud and on-premises environments
- Collaborate with data architects, analysts, and business stakeholders to understand data requirements
- Integrate data from various sources including databases, SaaS platforms, APIs, and flat files
- Monitor and optimize data flows for performance, reliability, and cost-efficiency
- Ensure data quality, consistency, and governance across integrated systems
- Automate data workflows and support real-time data streaming
- Document integration processes and maintain technical specification
Requirements
Do you have experience in XML?, * 3+ years' experience working with database and related tools
- Strong proficiency with data virtualisation platforms and tools such as Teiid or similar
- Solid understanding of SQL, relational databases, and data modelling
- Experience with cloud platforms (AWS, Azure) and cloud-native data services
- Familiarity with RESTful APIs, JSON, XML, OData, and message queues (Kafka)
- Knowledge of data governance, security, and compliance best practices
Preferred Skills:
- Experience with cloud-based database solutions.
- Understanding of data lifecycle management and SOC2 security standards.
- Familiarity with geoscience disciplines, geospatial data and GIS tools (e.g., ArcGIS, QGIS) is advantageous.
- Scripting and automation (e.g., PowerShell, Python, Java).
- Experience with Gitlab.
- Knowledge of Spotfire data visualization platform or alternative dashboard solutions.
- Awareness of Agile delivery methodologies.