Senior Quality Engineer, Ai And Automation

C3 Ai
Toledo, Spain
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Amazon Web Services Automation of Tests Microsoft Azure Cloud Computing Computer Engineering Continuous Integration Learning Management Systems Python (Programming Language)
+13 more
Object-Oriented Software Development E2e Testing Selenium Software Engineering Google Cloud Large Language Models Prompt Engineering Git Containerization AI Platforms Information Technology Playwright SDET

Job description

Senior Quality Engineer, AI and Automation at C3 AI.About the role C3 AI is seeking a Senior Quality Engineer to lead the testing strategy for our enterprise AI platforms and applications.You will build automated frameworks and validation methods to ensure the accuracy and reliability of agentic workflows and AI-generated outputs.Key facts Location: Guadalajara, Jalisco, Mexico.Engagement: Full-time.What you’ll do Design and maintain automated test frameworks for UI, API, and end-to-end scenarios.Create test plans covering functional, integration, performance, and reliability requirements.Build validation processes for AI system accuracy, consistency, and safety.Develop quality metrics and dashboards to monitor system effectiveness.Incorporate automated quality gates into CI/CD pipelines.Identify system risks and lead resolution efforts.Mentor team members on quality engineering standards and best practices.Requirements Bachelor degree in Computer Science, Software Engineering, Computer Engineering, or a related field.5+ years of experience in Quality Engineering, SDET, or Software Engineering.Proficiency in Java, Python, or similar object-oriented languages.Experience with UI, API, and end-to-end test automation.Familiarity with tools like Playwright, Selenium, or Cypress.Experience with Git and CI/CD pipeline integration.Strong understanding of Agile methodologies and the software development lifecycle.Nice to have Experience testing machine learning systems, LLMs, AI agents, or RAG architectures.Knowledge of AI evaluation frameworks such as Ragas, LangSmith, or DeepEval.Familiarity with prompt engineering and AI model evaluation.Experience with cloud platforms like AWS, Azure, or GCP.Background in containerized environments and observability tools.Skills & tools Java, PythonPlaywright, Selenium, CypressGitCI/CD pipelinesAI evaluation frameworks (Ragas, LangSmith, DeepEval)Cloud platforms (AWS, Azure, GCP)Practical notes C3 AI offers a competitive compensation package and comprehensive benefits.The company is an Equal Opportunity and Affimitive Action Employer.#J-*****-Ljbffr

Requirements

Engagement: Full-time.What you’ll do Design and maintain automated test frameworks for UI, API, and end-to-end scenarios.Create test plans covering functional, integration, performance, and reliability requirements.Build validation processes for AI system accuracy, consistency, and safety.Develop quality metrics and dashboards to monitor system effectiveness.Incorporate automated quality gates into CI/CD pipelines.Identify system risks and lead resolution efforts.Mentor team members on quality engineering standards and best practices.Requirements Bachelor degree in Computer Science, Software Engineering, Computer Engineering, or a related field.5+ years of experience in Quality Engineering, SDET, or Software Engineering.Proficiency in Java, Python, or similar object-oriented languages.Experience with UI, API, and end-to-end test automation.Familiarity with tools like Playwright, Selenium, or Cypress.Experience with Git and CI/CD pipeline integration.Strong understanding of Agile

Benefits & conditions

methodologies and the software development lifecycle.Nice to have Experience testing machine learning systems, LLMs, AI agents, or RAG architectures.Knowledge of AI evaluation frameworks such as Ragas, LangSmith, or DeepEval.Familiarity with prompt engineering and AI model evaluation.Experience with cloud platforms like AWS, Azure, or GCP.Background in containerized environments and observability tools.Skills & tools Java, PythonPlaywright, Selenium, CypressGitCI/CD pipelinesAI evaluation frameworks (Ragas, LangSmith, DeepEval)Cloud platforms (AWS, Azure, GCP)Practical notes C3 AI offers a competitive compensation package and comprehensive benefits.The company is an Equal Opportunity and Affimitive Action Employer. #J-*****-Ljbffr

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:35 min

Selecting Selenium for browser automation and testing

Benjamin Bischoff Benjamin Bischoff · Europe 2026 Virtual

2:06 min

Elevating the QA engineering role for complex challenges

Ondřej Gróf Ondřej Gróf · WWC Europe 2026

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

3:21 min

Automating complete quality assurance pipelines with artificial intelligence

Evelyn Haslinger · LIVE

2:18 min

Evolution of web automation from Selenium to Puppeteer

Miki Lombardi · JS Congress

Videos

See all

Related articles

See all