> Markdown version of [/jobs/ext/1418970-data-engineer](https://www.wearedevelopers.com/jobs/ext/1418970-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** J&C Associates
- **Location:** London, UK
- **Experience:** Expert
- **Contract:** Temporary contract
- **Skills:** Java (Programming Language), A/B Testing, Application Programming Interfaces (APIs), Agile Methodology, Airflow, Amazon Web Services, Microsoft Azure, Databases, System Configuration, Continuous Integration, Data Security, Data Warehousing, Relational Databases, DevOps, Python (Programming Language), PostgreSQL, Cloud Services, Web Analytics, Scripting, Git, Pandas, Data Lakes, Pyspark, Data Analytics, Splunk, Text Files, Docker, Jenkins, Databricks
- **Published:** July 24, 2026
- **Apply:** https://www1.jobdiva.co.uk/portal/?a=34jdnwd4ls8uthmwrzi4o3humpp74fc3d5cx3iu8mtcrkknzjqz9d2mvwwdvi9j7.co.ukpid=0/jobs/11318379#/jobs/11318379

## About the Role

* 5-10 years of Industry Experience.
 * Passion for continuous betterment (i.e., better workflows, automation, efficiency).
 * Experience with Data Warehouse or Data Lake, choosing database architectures, optimizing SQL queries.
 * Experience in a DevOps role, configuring and launching Docker containers, Jenkins for CI/CD, airflow for scheduling.
 * 2-5 years of proven experience coding in Python/Java or any scripting language.
 * Excellent in teamwork and communication skills.

Preferred skills:

 * Experience and knowledge of Digital Analytics or Digital Marketing products.
 * Experience with storage, compute services (e.g., databricks) on a major cloud vendor like AWS or Microsoft Azure is a big plus.
 * Knowledge of statistics or experience with pandas, pyspark or R, to better connect with analysts.
 * Knowledge of A/B testing or data-driven experimentation frameworks.
 * Experience in a B2B environment is a plus.

## Description

* As a senior data platform engineer, you will build and maintain scalable, rock solid self-serve solutions for data analysts and support them by understanding the content and context of data as well as collaborating with them to figure out the best way to Extract, Transform, Load and access it.
 * The ideal candidate will have a passion for simplifying and automating workflows, for making things better, for being efficient and helping the team do more with less.

What you will do:

 * Work with data analysts to determine the best schemas to translate available data sources into business domains.
 * Build connectors to integrate with Postgres-based RDBMSs, cloud solutions like AWS, Azure.
 * Write scripts to retrieve data from RDBMSs, logging systems (e.g., Splunk), APIs, text files.
 * Work with external partners to facilitate data access.
 * Make data workflows more efficient and automate them when possible.
 * Lead sophisticated, large-scale projects in an Agile environment using Git, Jenkins, Docker.


## Related Videos

- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture)
- [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)
- [Getting to Know Your Legacy (System) with AI-Driven Software Archeology](https://www.wearedevelopers.com/videos/1437-getting-to-know-your-legacy-system-with-ai-driven-software-archeology)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)