Software Engineer in Test for AI Model Engineering

As a Software Engineer in Test for AI Model Engineering, you will play a key role in ensuring the quality of AI-powered capabilities in MATLAB, as well as the tools that empower our customers to build their AI systems. You will join the Text Analytics Toolbox and Generative AI Model Engineering team, which is responsible for building and validating AI features including MATLAB Copilot, large language model (LLM) integrations, and text understanding and natural language processing workflows, in this fast-changing field.

MathWorks nurtures growth, appreciates inclusivity, encourages initiative, values teamwork, shares success, and rewards excellence.

• Design and implement test suites for AI-powered features, including probabilistic systems where outputs are non-deterministic
• Build and maintain evaluation datasets for model-driven features
• Define quality metrics beyond pass/fail (e.g., relevance, correctness, usefulness, latency, stability) for model training
• Driving testability through software architecture and unit testing
• Leading departmental projects to leverage Gen-AI for force-multiplying tooling

• Test automation experience
• Familiarity and understanding of LLMs and Generative AI

Nice to have:

• Hands on experience with coding agents or AI assistants

• Experience with C++

• Experience with MATLAB

• A bachelor's degree and 6 years of professional work experience (or a master's degree and 3 years of professional work experience, or a PhD degree, or equivalent experience) is required.