Senior Software Engineer Test - AI Model Engineering

As a Software Engineer in Test for AI Model Engineering, you will play a key role in ensuring the quality of AI-powered capabilities in MATLAB, as well as the tools that empower our customers to build their AI systems. You will join the Text Analytics Toolbox and Generative AI Model Engineering team, which is responsible for building and validating AI features including MATLAB Copilot, large language model (LLM) integrations, and text understanding and natural language processing workflows, in this fast-changing field., * Design and implement test suites for AI-powered features, including probabilistic systems where outputs are non-deterministic

• Build and maintain evaluation datasets for model-driven features
• Define quality metrics beyond pass/fail (e.g., relevance, correctness, usefulness, latency, stability) for model training
• Driving testability through software architecture and unit testing
• Leading departmental projects to leverage Gen-AI for force-multiplying tooling

• A bachelor’s degree and 6 years of professional work experience (or a master’s degree and 3 years of professional work experience, or a PhD degree, or equivalent experience) is required., * Test automation experience
• Familiarity and understanding of LLMs and Generative AI

Nice to have:

• Hands on experience with coding agents or AI assistants
• Experience with C++
• Experience with MATLAB

Why MathWorks?

It’s the chance to collaborate with bright, passionate people. It’s the opportunity to accelerate the pace of discovery, innovation, and learning in engineering and science. And it’s a commitment to doing the right thing-for each individual, our customers, and the local community. We cultivate an enjoyable, participatory, and rational environment that champions individual growth, encourages initiative, values collaboration, shares success, and rewards excellence.

MathWorks develops MATLAB and Simulink, the leading technical computing software used by engineers and scientists. The company employs more than 6,500 people in 16 countries, with headquarters in Natick, Massachusetts, USA. MathWorks is privately held and has been profitable every year since its founding in 1984.