> Markdown version of [/jobs/ext/2727430-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2727430-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Infinity Quest
- **Location:** UK
- **Experience:** Expert
- **Salary:** £52,914.0
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Airflow, Amazon Web Services, Amazon S3, Microsoft Azure, Big Data, Computer Programming, Continuous Integration, Extract Transform Load (ETL), DevOps, Python (Programming Language), PostgreSQL, NumPy, Scrum Methodology, Selenium, SQL Databases, Scripting, Apache Spark, Git, Pandas, Atlassian Bamboo, Jenkins, Databricks
- **Published:** September 5, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5870922543

## About the Role

Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow
-Preferred Domain: Energy trading

8+ years of experience in python scripting.
Experience with python packages such as NumPy, pandas, polars beautiful soup, Selenium, Requests etc.
Experience in building native python ETL pipelines for scraping/processing.
Good to have experience in processing big data.
Proficient in SQL programming, Postgres SQL. Spark knowledge is a good to have
Knowledge on DevOps CI/CD like Azure Pipelines, Jenkins, Git.
Experience working with AWS services(S3, lambda,etc) and Azure Databricks.
Have experience in delivering project with Agile and Scrum methodology.
Able to co-ordinate with Teams across multiple locations and time zones
Strong interpersonal and communication skills with an ability to lead a team and keep them motivated.
Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow



## Related Videos

- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.](https://www.wearedevelopers.com/videos/562-vectorize-all-the-things-using-linear-algebra-and-numpy-to-make-your-python-code-lightning-fast)
- [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Getting to Know Your Legacy (System) with AI-Driven Software Archeology](https://www.wearedevelopers.com/videos/1437-getting-to-know-your-legacy-system-with-ai-driven-software-archeology)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)