Data Engineer

Eaglecliff Incorporated
United States
9 days ago
Apply on computerjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Microsoft Excel Airflow Amazon Web Services Data Analysis Microsoft Azure Data Infrastructure Github Scrum Methodology SAP (Applications) SonarQube SQL Databases Data Streaming
+8 more
Data Processing Pytest Data Lakes Data Management Azure Synapse Analytics Stream Analytics Amazon Redshift Databricks

Job description

Technology expert who constantly pursues knowledge enhancement and has inherent curiosity to understand work from multiple dimensions. Deep data focus with expertise in technology domain A skilled communicator capable of speaking to both technical developers and business managers. Respected and trusted by leaders and staff. Actively delivers the roll-out and embedding of Data Foundation initiatives in support of the key business programmers. Coordinate the change management process, incident management and problem management process. Present reports and findings to key stakeholders and be the subject matter expert on Data Analysis & Design. Drive implementation efficiency and effectiveness across the pilots and future projects to minimize cost, increase speed of implementation and maximize value delivery. Contributes to community building initiatives like CoE, CoP., Project Initiatives: To leverage trading information flow advantage across RDS to improve decision making and trading bias based on data insights.The project will increase value creation through collaboration, creating new cross commodity trading opportunities (in both Crude and Products). It will provide better investment in analysis capabilities, tools and infrastructure and more rapidly deploy near term value creation for trading desks.

Deliverables

  • Aim to tackle the low hanging fruit, getting things out of Excel, unlocking the power of new visualisation tools, restructuring and cleaning up existing models.
  • Support better analysis of Refinery maintenance, Crude supply & demand and Gasoline supply and demand amongst others.
  • Creation of a Data Lake and not a Data Swamp and will improve decision making & trading bias via insights from data
  • An Asset Capacity & Maintenance deployment will give T&S the summary of planned and unplanned Refinery Maintenance plus Capacity information

Requirements

Mandatory skills: AWS/Azure/SAP - Master ELT - Master Data Modeling - Master Data Integration & Ingestion - Skill Data Manipulation and Processing - Skill GITHUB, Action, Azure DevOps - Skill Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest - Skill

Optional skills: Experience in project management, running a scrum team. Experience working with BPC, Planning. Exposure to working with external technical ecosystem. MKDocs documentation

Benefits & conditions

With a focus within Energy Trading, Oil & Gas, Financial Markets and Commodities, we offer a transparent Recruitment Service that has proven to be reliable and effective for over 40 years. We are ISO accredited and proud of our excellent TrustPilot Reviews. Your search for a New Contract Assignment or for a New Permanent Job will be in safe hands with Eaglecliff Recruitment. Please telephone for an immediate response or email your CV for a quick response. Eaglecliff Ltd is acting in the capacity of an employment agency for permanent recruitment and an employment business for contractor resourcing.”, “industry”: “IT”, “baseSalary”: {“@type”: “MonetaryAmount”, “currency”: “GBP”, “value”: {“@type”: “QuantitativeValue”, “value”: “”}}, “identifier”: {“@type”: “PropertyValue”, “name”: “[[BRANDNAME]]”, “value”: “[[IDENTIFIER]]”}, “datePosted”: “2026-08-27T09:50+00:00”, “validThrough”: “2026-09-10T09:50+00:00”, “hiringOrganization”: {“@type”: “Organization”, “name”: “Eaglecliff Recruitment”, “logo”: “https://cjassets-fabkerfbaaayfhdm.z02.azurefd.net/images/jobbranding/49b5d585e21b/images/49b5d585e21b_detail.png”}, “jobLocation”: {“@type”: “Place”, “address”: {“@type”: “PostalAddress”, “addressRegion”: “England”, “addressLocality”: “London”, “addressCountry”: “United Kingdom”}, “geo”: {“@type”: “GeoCoordinates”, “latitude”: “51.512”, “longitude”: “-0.065”}}, “url”

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on computerjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

3:05 min

Tagging and organizing execution scenarios with pytest markers

Florian Bruhin · World Congress 2021

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

Videos

See all

Related articles

See all