> Markdown version of [/jobs/ext/2466321-data-engineer](https://www.wearedevelopers.com/jobs/ext/2466321-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Independent Media - **Location:** London, UK - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Java (Programming Language), A/B Testing, Airflow, Amazon Web Services, Data Analysis, Big Data, BigQuery, Cloud Computing, Cloud Storage, Databases, Data as a Services, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Structures, Data Systems, Data Warehousing, Relational Databases, Data Flow Control, Data Intelligence, Python (Programming Language), PostgreSQL, Metadata, MySQL, Cloud Services, Standard Sql, Cloudera, Scala (Programming Language), SQL Databases, Data Streaming, Unstructured Data, Web Analytics, Workflow Management Systems, Data Processing, Google Cloud, Cloud Platform System, Snowflake, Apache Spark, Kubernetes, Information Technology, Non-relational Database, Domo, Data Delivery, Data Pipelines, Programming Languages - **Published:** August 11, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=4ce663b7f29a41da ## About the Role * A data engineer with a good knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. * Experience in designing and maintaining scalable data pipelines and architectures-ideally integrating data from web analytics, content management systems (CMS), subscription platforms, ad tech, and social media. * Ability to automate and optimise data workflows, using modern ETL/ELT tools (e.g., Airflow, dbt, Apache Spark) to ensure timely and reliable delivery of data. * Some experience building robust data models and reporting layers to support performance dashboards, user engagement analytics, ad revenue tracking, and A/B testing frameworks. * Skilled in cloud-based data platforms and infrastructure (e.g., AWS, GCP), ensuring scalability and security for large volumes of streaming and batch data. Ideally had some exposure to data warehouses such as BigQuery or Snowflake. * Adept in Python and/or Java for developing data services and integrating APIs to bring in diverse sources of media data. * Strong interpersonal and communication skills, enabling effective collaboration with analytical and commercial teams to turn data into actionable insights. * Proactive and self-driven, capable of managing multiple data projects in a high tempo setting while meeting tight deadlines. * A continuous learner with a diligent approach to data engineering including data privacy (e.g., GDPR compliance) and evolving best practices., * SQL and Database Expertise: Strong working knowledge of SQL with hands-on experience querying and managing relational databases, alongside familiarity with a variety of database technologies (e.g., PostgreSQL, MySQL, BigQuery). * Big Data Engineering: Exposure to designing, building, and optimizing 'big data' pipelines, architectures, and datasets, enabling efficient data processing at scale. * Analytical Problem Solving: Ideally has performed root cause analysis on internal and external data sources and business processes to resolve issues and uncover opportunities for operational or strategic improvements. * Unstructured Data Handling: Capability for working with unstructured and semi-structured datasets, transforming raw information into actionable insights. * Data Workflow Development: Skilled in developing and maintaining data transformation processes, managing data structures, metadata, workload dependencies, and orchestration frameworks. * Large-scale Data Processing: A demonstrated history of manipulating, processing, and extracting value from large, diverse, and disconnected datasets in fast-moving environments. * Project Management & Collaboration: Strong project management and organizational skills, with experience supporting and collaborating with cross-functional teams in dynamic and evolving settings. * Education & Professional Background: Holds a graduate degree in Computer Science, STEM related quantitative field, with up to 2+ years of hands-on experience in a data engineering role. Tools & Technologies: * Databases: Proficient in relational SQL databases. * Workflow Management Tools: Exposure to orchestration platforms such as Apache Airflow. * Programming Languages: Skilled in one or more of the following languages, i.e.: Python, Java, Scala. * Cloud Infrastructure: Understanding of cloud infrastructure such as GCP and tools within the respective platform. ## Description We are looking for a Data Engineer to join our team. They will be responsible for maintaining and supporting the existing data infrastructure used to underpin our data analytics and reporting. They will be accountable for building as well as owning new engineering solutions. These must complement our current, scalable data architecture. The Data Engineer will be expected to optimize the architecture of our data pipelines and ensure that data flows support various cross functional teams across the business. The ideal candidate will have a self-directed, innovative mindset who is comfortable supporting the data needs of multiple teams. The right candidate will be proactive in identifying and implementing improvements for our systems contributing constructively to the current data eco-system. As the business continues to invest in cloud solutions, particularly Google Cloud Platform, you will be excited by the prospect of owning new projects, propelling our data initiatives and capabilities. The Data Engineer will be exposed to best practice methods with the current framework. The Data & Marketing Department The Data & Marketing department is the intelligence powerhouse of the business, representing the customer. Our goal is to inspire, engage and grow a loyal readership by harnessing data-driven insights and innovative marketing to deliver personalised, impactful content experiences that builds lasting trust, diverse revenue streams, and a thriving future for quality journalism. The department consists of four teams: Data Science & Engineering, Data Intelligence & Monetisation, Research & Insight and Customer Marketing. Data Science & Engineering The purpose of this team is to develop, maintain and optimise our best-in-class data ecosystem, developing products and services that increase efficiencies, profitability and enhance our understanding of the customer. The team's output underpins the success of the business and plays a crucial role in supporting its future growth. Diversity, Equity and Inclusion * We champion diversity in our teams and in our reporting. As a growing and global brand, we must have a workforce that's more representative of our readers, viewers, clients and partners, and a workplace that creates a sense of belonging for everyone * We are committed to hiring and developing a diverse workforce regardless of background, and we support our people to thrive in their careers here. The Independent is an equal opportunities employer, if you require any reasonable adjustments to complete your application, please do not hesitate to advise us accordingly., * Design and Maintain Data Pipelines: Develop and maintain robust, scalable, and efficient data pipeline architecture to support current and future business needs. * Engineering and Integration: Assemble large, complex datasets from a variety of structured and unstructured sources, ensuring they meet functional requirements. * Process Automation and Optimisation: Identify, design, and implement improvements to automate manual processes, enhance data delivery performance, and re-architect infrastructure for improved scalability and resilience. * ETL Development and Infrastructure Building: Build and manage the infrastructure necessary for optimal ETL or ELT of data using Python, SQL, and Google Cloud Platform (GCP) big data technologies, such as BigQuery, Dataflow, Dataproc and Cloud Storage. * Business Intelligence Enablement: Prepare and transform pipeline data to support downstream analytics and feed BI tools (DOMO), enabling data-driven decision-making across the organization. * Cross-Functional Collaboration: Partner with internal stakeholders-ranging from Data, Commercial, and Editorial teams to executive leadership-to address data-related technical challenges and support their infrastructure needs. * Enhance Data System Functionality: Collaborate with the Data Team to continuously improve the functionality, flexibility, and performance of data systems and platforms. * Data Governance and Compliance: Ensure all data is handled responsibly, securely, and in full compliance with the Data Protection Act, GDPR regulations, and the Company's Code of Conduct. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Coding for Good: Achieving social change with an app](https://www.wearedevelopers.com/videos/1645-coding-for-good-achieving-social-change-with-an-app) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)