> Markdown version of [/jobs/ext/2324673-data-engineer-security-clearance-required](https://www.wearedevelopers.com/jobs/ext/2324673-data-engineer-security-clearance-required). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer-Security Clearance Required - **Company:** The Counter - **Location:** Manchester, UK - **Salary:** £50,000.0 - £55,000.0 - **Contract:** Temporary contract - **Skills:** Agile Methodology, Artificial Intelligence, Automation of Tests, Bash Shell, Databases, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Virtualization, Data Visualization, Linux, Metadata, Pentaho Data Integration, Power BI, Software Construction, Software Engineering, SQL Databases, Data Processing, Scripting, Large Language Models, Grafana, Prompt Engineering, Cypress (Programming Language), Git, Front End Software Development, Restful APIs, Data Pipelines, Dynatrace, Docker, Programming Languages - **Published:** August 7, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=9d8d52b020912f78 ## About the Role * has a deep appreciation of reproducible CI/CD pipelines which include automated tests, and knows how to deploy end-to-end to Production environments. * has a deep working knowledge of their chosen programming language and related toolsets. Has applied software engineering best practices and design principles to data pipelines. * understands the security implications related to developing and operating data processing platforms. * has a breadth of experience across data tech and chooses the right tool for the right job. They understand data changes at scale, know how to ensure data quality at all stages and apply the fundamentals of data modelling based on usage. * Is able to craft high-quality, resilient Data Pipelines for ingesting, transforming and exporting data. They are able to critically evaluate and choose appropriate orchestration/choreography tools, know how to exploit parallelism and pushdown/offload, build in monitoring, are aware of the complexity of testing data pipelines, and follow functional data engineering principles. * Is able to craft views and queries that answer analytical questions in a concise and efficient manner using SQL. Has a deep experience of at least one, preferably more, SQL dialects. Is able to analyse and optimise queries and understand their dependence on indexing and partitioning. Is able to effectively decompose complex data projections using CTEs. * Has an appreciation of key data governance concerns and experience in designing and implementing solutions for them. * Primarily is willing to help others. Is capable and happy to pair with others. Seeks peer review on work. Considers processes, clients needs as well as technology when working. Also has good interpersonal skills * Understands the practices and principles underpinning agile software development. Able to adjust their ways of working based on the client's maturity, * Have Permanent Right to Work in The UK * Be happy to have evidence of Right to work and Enhanced DBS checks completed * Be eligible for SE Clearance/already have Security Clearance * Must have lived continuously in the UK for the last 5 years (no absence of more than 6 months) ## Description As an Data Engineer, you will play an important role in supporting live data services while contributing to platform improvements and automation initiatives. We are particularly interested in candidates who: * Have experience with Pentaho, databases and SQL * Are user-focused and comfortable engaging with stakeholders * Enjoy problem-solving in fast-paced environments Show strong collaboration skills and eagerness to learn, * Pentaho Business Analytics (metadata & BI models) * Pentaho Data Integration (PDI) and ETL workflow * SQL query writing and troubleshooting * Database fundamentals * Git version control * Bash scripting for Linux automation, deployment, and orchestration * Python scripting for automation and tooling * GitLab CI/CD pipeline configuration and orchestration * Software development for building automation tools and workflows * REST API integration for workflow automation * Docker containerisation and orchestration AI/LLM tool usage (prompt engineering and developer assistance tools) * Data virtualisation tools (e.g., Denodo) * Monitoring and alerting platforms (Grafana, Dynatrace) * Power BI or other data visualisation platforms * Front-end testing tools (e.g., Cypress) * Experience in frontline technical support environments ## Related Videos - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)