> Markdown version of [/jobs/ext/1225461-senior-python-data-engineer](https://www.wearedevelopers.com/jobs/ext/1225461-senior-python-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Python Data Engineer - **Company:** Norton Blake - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Amazon S3, Microsoft Azure, Big Data, Cloud Computing, Databases, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Dataspaces, DevOps, Python (Programming Language), PostgreSQL, NumPy, Scrum Methodology, Azure DevOps Pipelines, Selenium, SQL Databases, Data Processing, Scripting, Freeform SQL, Apache Spark, Git, Fastapi, Pandas, Deployment Automation, Integration Frameworks, Data Pipelines, Jenkins, Databricks - **Published:** July 10, 2026 - **Apply:** https://find.jobs/jobs-near-me/apply/ats-redirect/?id=2865350221-2 ## About the Role * Industry Experience: A proven track record working within the Energy Trading or broader trading/commodities domain is essential. * Experience Level: 8+ years of dedicated experience in Python scripting and data engineering. * Core Tech Stack: Deep proficiency with Python, Postgres SQL, Azure Databricks, AWS (S3), Git, Azure DevOps CI/CD, and Apache Airflow. * Python Ecosystem: Extensive, recent hands-on experience utilizing NumPy, Pandas, Polars, BeautifulSoup, Selenium, and Requests. * Data Ecosystems: Strong background in building native Python ETL pipelines for data scraping/processing. Big Data experience or knowledge of Spark is highly advantageous. Important Note for Applicants * Recent Hands-On Code Execution is Required: This role is for a pure, active developer. If your recent experience has drifted into pure management or architecture without daily coding, this will not be the right fit. * Technical Assessment: Candidates must be fully prepared to complete a rigorous live technical assessment/coding questions focusing on core Python and data engineering competencies. * Industry experience: Must have experience operating within the energy trading sector, If you have the recent, deep-dive Python expertise and the Energy Trading background required to excel in this role, the team at Norton Blake wants to hear from you. ## Description As a Senior Data Engineer, you will bridge the gap between heavy-duty data engineering and core Python enterprise development. You will take technical ownership of designing, optimizing, and scaling native Python ETL pipelines and robust data processing frameworks. Given the nature of the trading floor, this role demands someone who thrives under agility, coordinates seamlessly across global time zones, and brings a strong, motivated leadership presence to the technical team., * Pipeline Architecture: Lead the design, end-to-end development, and optimization of highly scalable data pipelines and enterprise-grade Python applications. * Technical Leadership: Serve as the subject matter expert for Python development, championing best practices for automation, scraping, data processing, and integration workflows. * Data Manipulation: Extract and process complex datasets using data-centric libraries (Pandas, NumPy, Polars) and scraping/parsing tools (BeautifulSoup, Selenium, Requests, pdfplumber). * Database & Cloud Management: Architect and optimize complex SQL queries in PostgreSQL. Manage and deploy cloud-based workflows seamlessly across AWS (S3) and Azure Databricks. * DevOps Integration: Embed CI/CD best practices using Azure DevOps, Jenkins, and Git to ensure smooth, automated deployments. * Agile Delivery: Drive project delivery using Scrum/Agile methodologies, coordinating effectively with cross-functional teams across multiple geographic locations. ## Related Videos - [Python-Based Data Streaming Pipelines Within Minutes](https://www.wearedevelopers.com/videos/1233-python-based-data-streaming-pipelines-within-minutes) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.](https://www.wearedevelopers.com/videos/562-vectorize-all-the-things-using-linear-algebra-and-numpy-to-make-your-python-code-lightning-fast) - [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript) - [Getting to Know Your Legacy (System) with AI-Driven Software Archeology](https://www.wearedevelopers.com/videos/1437-getting-to-know-your-legacy-system-with-ai-driven-software-archeology) - [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [A Guide to Green Tech and Green IT Careers](https://www.wearedevelopers.com/magazine/374-a-guide-to-green-tech-and-green-it-careers) - [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers)