> Markdown version of [/jobs/ext/2273930-senior-test-automation-engineer-data-ai-team](https://www.wearedevelopers.com/jobs/ext/2273930-senior-test-automation-engineer-data-ai-team). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Test Automation Engineer - Data & AI Team - **Company:** Sofico - **Location:** (Gent), Belgium - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Automation of Tests, Microsoft Azure, Cloud Computing, Software Quality, Continuous Integration, DevOps, Distributed Systems, Python (Programming Language), Mockito, Workflow Management Systems, Enterprise Software Applications, Spring Cloud, Large Language Models, Backend, Containerization, AI Platforms, Kubernetes, Deployment Automation, Playwright, Microservices - **Published:** August 28, 2026 - **Apply:** https://www.adzuna.be/details/5848289047 ## About the Role We're looking for a strong overall profile, without expecting you will tick every box. Please indicate in your application your current experience level (e.g. none / familiar / proficient / expert) for each of the areas below. This helps us understand your profile and have a more focused conversation. * Test automation engineering: unit/integration/e2e frameworks, CI/CD integration * Testing APIs, backend services, microservices, and distributed systems * Programming in Java and/or Python, including typed schemas, mocking, and test-data setup/teardown * Designing scalable automation frameworks from the ground up, and coaching others in their adoption * Non-deterministic / AI evaluation testing: LLM-as-a-judge, benchmarking, quality metrics for agentic systems (plus) * Workflow orchestration platforms, cloud-native applications, and LLM/agentic systems (plus) * Tooling such as Playwright, Kubernetes, and modern DevOps practices (advantage) An analytical mindset, attention to detail, and a genuine drive to improve software quality matter as much as any single line above. ## Description At SOFICO, we're building the future of mobility through Miles, our market-leading platform for leasing, fleet, and mobility operations worldwide. As an international team, we combine innovation, collaboration, and ownership to deliver real impact for our customers, in a culture of continuous learning, mutual support, and shared success. From our office in Ghent, we are scaling our Data & AI organization, the team behind SOFICO AI Cloud and the Miles Enterprise Agentic Platform (AutoPilot & AutoRoute). Our platform combines AI, cloud-native technologies, and enterprise software, leveraging Java/Quarkus services, Python/LangGraph agents, Azure AI Foundry, Temporal workflows, and Langfuse observability. As a Senior Test Automation Engineer, you will drive the quality and reliability of this platform by building and owning a robust test automation strategy across the entire AI ecosystem. Working closely with engineers across AI Runtime, Cloud Ops, API & Saga, Knowledge, Governance, and Data teams, you will ensure that critical business flows, integrations, and AI-powered capabilities are validated through scalable, automated testing., * Own and evolve the test automation strategy for the Data & AI platform - unit, integration, contract, regression, and end-to-end - designing, building, and maintaining automated frameworks and suites integrated into CI/CD pipelines. * Validate end-to-end business processes within sandboxed Miles environments, ensuring correctness, reliability, and safe failure handling. * Develop API and contract testing approaches for distributed services and integrations. Non-deterministic testing (AI and agentic behavior) * Design and own evaluation approaches for AI-powered and agentic capabilities where outcomes are probabilistic rather than pass/fail: LLM-as-a-judge setups, baseline/benchmark datasets, and process/quality metrics for agent behavior. * Establish baselines and regression tracking for model and agent output quality over time, this alongside the deterministic CI gates. Platform-wide * Collaborate across engineering domains to ensure platform-wide quality and release confidence. * Drive continuous improvement in test automation practices and tooling, and act as a mentor and quality advocate, helping teams adopt effective automated testing approaches. ## Related Videos - [How will artificial intelligence change the future of software testing?](https://www.wearedevelopers.com/videos/85-how-will-artificial-intelligence-change-the-future-of-software-testing) - [Test-Driven Development: It's easier than you think!](https://www.wearedevelopers.com/videos/1598-test-driven-development-it-s-easier-than-you-think) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [ChatGPT and Java: A Match Made in Heaven or Hell?](https://www.wearedevelopers.com/videos/536-chatgpt-and-java-a-match-made-in-heaven-or-hell) - [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean) ## Related Articles - [The 8 Best Code Testing Tools](https://www.wearedevelopers.com/magazine/402-the-8-best-code-testing-tools) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)