Agentic AIOps- Quality Automation Engineer

NN Group
Municipality of Madrid, Spain
28 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Remote
Municipality of Madrid, Spain

Tech stack

API
Agile Methodologies
Artificial Intelligence
Automation of Tests
Azure
Cloud Computing
Large Language Models
Machine Learning Operations
Data Pipelines
Databricks
Microservices

Job description

NN Digital Hub is a subsidiary company of Nationale Nederlanden Group located in Madrid, Spain. We deliver IT services and solutions for the different international Business Units from Nationale Nederlanden Group. Our objective is to create, deliver and maintain insurance product management solutions, as service propositions to enable any agent (linked or direct), machine or company to create and sell insurance products in Europe in an automated way and real time. We deliver IT services and solutions for the different international Business Units from Nationale Nederlanden Group We are seeking an experienced Agentic AIOps- Quality Automation Engineer to implement end to end QA strategy for our Agentic AI Platform. It plays a pivotal role in ensuring we provide reliable, compliant and trustworthy infrastructure to various business and technical users to design, develop and productionize AI Agents. You will be part of Cross-Functional Empowered Product Team within Platform Enablement Team responsible for developing Agentic AI Platform for NN and work together with various MLOPs/LLMOps engineers, Data Scientists, Data Engineers to realise Agentic AI use cases for entire NN ecosystem. Your Impact as Agentic AIOps- Quality Automation Engineer: In this role, you will design and execute QA frameworks that are applicable for provisioning Agentic AI ecosystems for our clients (NN ecosystem). It includes end-to-end testing of applications within the Agentic AI platform such as orchestration of MLOps/LLMOps workflows & AI agents configured within multi-cloud environments and relying on enterprise data products. You will ensure our AI solutions and the data powering them are accurate, trustworthy, performant, and compliant. There is a degree of autonomy expected and out of the box thinking. Taking initiatives and providing pro-active insights to make the solution more robust and scalable are highly appreciated. Your Responsibilities:

  • Define and execute QA strategy for Agentic AI platform, including agent orchestration, LLM/API integrations, prompt testing, hallucination mitigation, safety guardrail validation, and model evaluation.
  • Lead testing across the ecosystem: data pipelines, ML models, APIs, dashboards, cloud environments, and AIdriven applications.
  • Implement automation for endtoend testing of agentic workflows, APIs, and platform services; integrate with CI/CD pipelines.
  • Establish AI-specific testing practices, including evaluation of LLMs, agent workflows, guardrails, and model drift.
  • Collaborate with engineers, data scientists, product owners, and AI governance stakeholders to ensure safe deployment of Agentic AI features.

What do we offer? As part of our Employee Experience, we offer you a range of competitive benefits that are available to you in order to improve the physical, mental, and professional wellbeing of our workers. Among the benefits are:

  • We work with a hybrid model
  • Starting financial aid so you can equip your workspace at home
  • Allowance and telework subventions
  • Flexible working hours and 2 months of intensive working hours in summer so you can fully take advantage of your time
  • We hire a life insurance and a pension plan for all our employees
  • We establish objectives bonus as a performance reward
  • You can get to the office as you please. We have a free parking lot for cars, motorbikes, electric cars with chargers, and bikes.
  • Get to know our flexible retribution facilities such as transport card, nursery checks, health insurance with Sanitas, trainings…
  • We care about people. That is why we are involved in society by facilitating volunteer actions and time to all our employees.
  • We care about your wellbeing. We have a Wellness Program available.
  • We are digital and we love technology. Also, every team works under agile methodology.

Requirements

Do you have experience in Microservices?, Do you have a Master's degree?, * 3+ years in MLOPs focusing on testing and validation of end-to-end ML & AI driven applications.

  • Strong knowledge of cloud platforms (Azure/Databricks), APIs, microservices, and automated testing frameworks.
  • Working experience with Agentic AI automation is a strong plus.

If you are a passionate and experienced Agentic AIOps- Quality Automation Engineer looking for an exciting opportunity to work in a dynamic and challenging environment, we encourage you to apply for this position. We are waiting for you!

Apply for this position