Senior Python Data Engineer

Norton Blake
London, UK
about 1 month ago
Apply on find.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Airflow Amazon Web Services Amazon S3 Microsoft Azure Big Data Cloud Computing Databases Continuous Integration Information Engineering Extract Transform Load (ETL) Dataspaces
+20 more
DevOps Python (Programming Language) PostgreSQL NumPy Scrum Methodology Azure DevOps Pipelines Selenium SQL Databases Data Processing Scripting Freeform SQL Apache Spark Git Fastapi Pandas Deployment Automation Integration Frameworks Data Pipelines Jenkins Databricks

Job description

As a Senior Data Engineer, you will bridge the gap between heavy-duty data engineering and core Python enterprise development. You will take technical ownership of designing, optimizing, and scaling native Python ETL pipelines and robust data processing frameworks.

Given the nature of the trading floor, this role demands someone who thrives under agility, coordinates seamlessly across global time zones, and brings a strong, motivated leadership presence to the technical team., * Pipeline Architecture: Lead the design, end-to-end development, and optimization of highly scalable data pipelines and enterprise-grade Python applications.

  • Technical Leadership: Serve as the subject matter expert for Python development, championing best practices for automation, scraping, data processing, and integration workflows.
  • Data Manipulation: Extract and process complex datasets using data-centric libraries (Pandas, NumPy, Polars) and scraping/parsing tools (BeautifulSoup, Selenium, Requests, pdfplumber).
  • Database & Cloud Management: Architect and optimize complex SQL queries in PostgreSQL. Manage and deploy cloud-based workflows seamlessly across AWS (S3) and Azure Databricks.
  • DevOps Integration: Embed CI/CD best practices using Azure DevOps, Jenkins, and Git to ensure smooth, automated deployments.
  • Agile Delivery: Drive project delivery using Scrum/Agile methodologies, coordinating effectively with cross-functional teams across multiple geographic locations.

Requirements

  • Industry Experience: A proven track record working within the Energy Trading or broader trading/commodities domain is essential.
  • Experience Level: 8+ years of dedicated experience in Python scripting and data engineering.
  • Core Tech Stack: Deep proficiency with Python, Postgres SQL, Azure Databricks, AWS (S3), Git, Azure DevOps CI/CD, and Apache Airflow.
  • Python Ecosystem: Extensive, recent hands-on experience utilizing NumPy, Pandas, Polars, BeautifulSoup, Selenium, and Requests.
  • Data Ecosystems: Strong background in building native Python ETL pipelines for data scraping/processing. Big Data experience or knowledge of Spark is highly advantageous.

Important Note for Applicants

  • Recent Hands-On Code Execution is Required: This role is for a pure, active developer. If your recent experience has drifted into pure management or architecture without daily coding, this will not be the right fit.
  • Technical Assessment: Candidates must be fully prepared to complete a rigorous live technical assessment/coding questions focusing on core Python and data engineering competencies.
  • Industry experience: Must have experience operating within the energy trading sector, If you have the recent, deep-dive Python expertise and the Energy Trading background required to excel in this role, the team at Norton Blake wants to hear from you.

About the company

Norton Blake is partnering with a premier, global player within the Energy & Trading sector to find a heavyweight Senior Data Engineer. This is a long-term contract opportunity based in their state-of-the-art Canary Wharf office, offering the chance to lead and architect enterprise-grade data solutions within a fast-paced, high-impact environment.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on find.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:34 min

Maximizing execution memory effectively via python numpy broadcasting

Jodie Burchell · LIVE

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · World Congress 2024

3:33 min

Refactoring data science workflows using Rapids QDF and Pandas

Paul Graham Paul Graham · LIVE

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

Videos

See all

Related articles

See all