> Markdown version of [/jobs/ext/351425-data-engineer](https://www.wearedevelopers.com/jobs/ext/351425-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** RocketFin Consulting Ltd
- **Location:** London, UK
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Data Analysis, Microsoft Azure, Big Data, Databases, Information Engineering, Web Scraping, Data Systems, Data Warehousing, Python (Programming Language), Machine Learning, Power BI, SQL Databases, Data Processing, Real Time Systems, Azure Data Factory, Snowflake, Grafana, Backend, Playwright, Data Management, Api Design, Streamlit Framework, Data Pipelines, Databricks
- **Published:** June 18, 2026
- **Apply:** https://uk.indeed.com/viewjob?jk=566d81e2a96ac3ae

## About the Role

Do you have experience in SQL?, Technical

 * Strong proficiency in Python for data engineering and pipeline development
 * Hands-on experience with Azure data services (Data Factory, Databricks, Blob Storage, etc.)
 * Experience designing and optimising Snowflake data models
 * Proven track record building and maintaining data pipelines at scale
 * Experience integrating third-party market data APIs and external data feeds
 * Familiarity with SQL and data warehousing concepts

Domain

 * Experience or strong interest in energy, commodities, or financial markets data
 * Understanding of real-time and batch data processing patterns in a trading context
 * Familiarity with market data providers such as ENTSOE, EPEX, KPLER, or similar, * Experience with web scraping frameworks (e.g. Scrapy, BeautifulSoup, Playwright)
 * Knowledge of LNG, Gas, or Power market fundamentals
 * Experience supporting ML model pipelines or demand forecasting workflows
 * Exposure to GUI/dashboard tools such as Grafana, Power BI, or Streamlit
 * Knowledge of ship tracking data or AIS feeds

## Description

Data Engineering & Pipelines

 * Build and enhance data pipelines and automation workflows on Azure for large-scale data ingestion and processing
 * Maintain and optimise existing toolkits, databases, dashboards, and API-based solutions
 * Develop end-to-end automated data solutions across commodities (Gas/LNG, Power, Weather)
 * Design and implement web scraping pipelines (e.g. US LNG data)

Analytics & Real-Time Systems

 * Support real-time and batch analytics use cases in a dynamic trading environment
 * Enable and support analytics dashboards and GUI tools with reliable backend infrastructure
 * Develop real-time flow tracking solutions at critical market points

Data Modelling & Architecture

 * Design and manage Snowflake data models, ensuring performance and scalability
 * Integrate external data sources including ENTSOE, EPEX, KPLER, MetDesk, WoodMac, and others
 * Collaborate with analytics teams to structure data for models and advanced analytics use cases
 * Build and maintain data platforms supporting ML models such as demand forecasting

Key Deliverables

 * LNG Sendout Optimisation Model
 * Ship Tracking & Flow Monitoring Tools
 * Prompt Price & Forward Curve Bootstrapping
 * Web scraping pipelines for US LNG and other market data sources
 * Real-time flow tracking infrastructure at critical market points
 * Data platforms supporting ML and demand forecasting models


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science, ML & AI in the Oil and Gas Industry at NDT Global - Dr. Katja Träumner](https://www.wearedevelopers.com/videos/1308-data-science-ml-ai-in-the-oil-and-gas-industry-at-ndt-global-dr-katja-traumner)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)