Data Engineer

QualiTest
London, UK
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Google App Engines Automation of Tests Big Data BigQuery Cloud Computing Encodings Continuous Integration Data Architecture Information Engineering Data Governance
+18 more
Data Flow Control Graph Database Python (Programming Language) Meta-Data Management Systems Development Life Cycle Cloud Services Standard Sql Search Technologies Software Construction SQL Databases Data Streaming Policy as Code Multi-Agent Systems Kubernetes Infrastructure Automation Frameworks Information Technology Software Version Control Data Pipelines

Job description

Qualitest is looking for a senior AI-Native Data Engineer to join the Governance Technology Team within our clients Research’s Risk, Resiliency & Regulatory Governance organisation. This team is focused on building the next generation of governance infrastructure to support AI governance, risk management, security, privacy, and regulatory oversight across Research and Labs product areas. In this role, you will be responsible for designing and scaling robust data pipelines and governance graph architectures that enable structured oversight of datasets, models, systems, approvals, controls, and risks. You will work closely with cross-functional stakeholders including ML Engineers, Security Engineers, Privacy Engineers, TPMs, and Product teams to operationalise graph-based governance solutions across highly complex technical environments. The position sits at the intersection of large-scale data engineering, AI systems, graph technologies, and governance frameworks within a highly innovative and fast-paced environment., * Design, build, and maintain scalable batch and streaming data pipelines using internal and cloud technologies

  • Develop and evolve governance knowledge graphs representing datasets, models, approvals, systems, controls, and risk relationships
  • Create unified data models to map relational and structured data into graph-based architectures
  • Partner with governance stakeholders including security, privacy, legal, and risk teams to define graph ontology and schema requirements
  • Establish and maintain data quality, integrity, lineage, and governance controls across pipelines and graph systems
  • Support GraphRAG implementations using vector search, graph databases, and semantic search technologies
  • Build and manage orchestration workflows using technologies such as Dataflow, Vertex AI, Cloud Composer (Airflow), and Plx Workflows
  • Leverage AI-assisted development tooling and automated engineering workflows to improve engineering efficiency and delivery quality
  • Contribute to CI/CD, automated testing, infrastructure as code, and software engineering best practices

Requirements

Do you have experience in Test automation?, * 5+ years of experience within Data Engineering, Backend Engineering, or Data Architecture environments

  • Experience working with cloud data platforms, ideally within GCP environments including BigQuery, Dataflow, and Vertex AI
  • Strong understanding of graph databases, graph data modelling, ontology design, and graph query languages such as GQL, Cypher, or SQL/PGQ
  • Expert-level Python and SQL skills
  • Strong understanding of data governance principles including data quality, metadata management, lineage, privacy, and security
  • Experience working with modern SDLC practices including CI/CD, automated testing, and version control
  • Experience using AI-assisted engineering and development tooling within engineering workflows

Preferred Experience

  • Experience with Spanner Graph and/or BigQuery Graph
  • Familiarity with vector databases and embedding generation pipelines
  • Experience with multi-agent orchestration frameworks such as LangGraph
  • Exposure to policy-as-code frameworks
  • Experience with data cataloguing and automated lineage tooling
  • Academic background in Computer Science, Data Science, Mathematics, or related technical disciplines

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:27 min

Explaining query execution overhead and caching limitations in BigQuery

Adnan Rahic · JS Congress

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · WWC 2024

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all