> Markdown version of [/jobs/ext/91712-working-student-ai-based-quality-evaluation-for-ai-generated-code-changes-sap-hana-cloud](https://www.wearedevelopers.com/jobs/ext/91712-working-student-ai-based-quality-evaluation-for-ai-generated-code-changes-sap-hana-cloud). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Working Student - AI-based Quality Evaluation for AI-Generated Code Changes (SAP HANA Cloud) - **Company:** SAP AG - **Location:** Walldorf, Germany - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Cloud Computing, Code Review, Computer Programming, Python (Programming Language), Machine Learning, SAP (Applications), SAP HANA, Large Language Models, Information Technology, Production Code, Maintaining Code, Machine Learning Operations, Programming Languages - **Published:** May 31, 2026 - **Apply:** https://de.indeed.com/viewjob?jk=5834742e7e99c891 ## About the Role Do you have experience in SAP HANA?, Do you have a Master's degree?, * Student of computer science, data science, computer linguistics, mathematics or related field at a higher education institution * Experience with programming, machine learning and LLMs, demonstrated by existing projects. * Comfortable with English for daily communication (B level). German (B level) is a plus. * Good grades shown by a Transcript of Records (ToR) / Grades The application must contain (English or German): * A cover letter that expresses your interest * A CV that provides information about your programming experience * A transcript of records (ToR) that contains grades of all university-level courses/degrees Where you belong Join a team that values creativity, encourages risk-taking, and counts on your unique ideas. Our goal is to build and maintain a state-of-the-art agentic AI coding platform for SAP HANA. Your set of application documents should contain a cover letter, a resume in table form, school leaving certificates, certificate of enrollment, current university transcript of records, copies of any academic degrees already earned, and if available, references from former employers (including internships). Please also describe your experience and skills in foreign languages and computer programs / programming languages. This is a SAP global, strategic, paid working student position that provides students with opportunities to find purpose in their careers. ## Description In their day-to-day development, SAP HANA developers review code changes generated by AI coding agents. These changes must meet high quality standards before they can be merged into production code. Today, we verify that AI-generated code passes determistic verification (e.g. linting, tests) but we don't yet measure whether changes fulfill other criteria (e.g code conventions). This can lead to a lower acceptance of AI-generated changes. In this project you design and run experiments to evaluate an automated quality evaluation system that uses large language models and techniques like LLM-as-a-Judge to assess AI-generated changes. You build a ground-truth dataset from real developer review feedback, design a structured scoring rubric, and benchmark how well an LLM judge correlates with human decisions. The project is implemented in Python and makes use of modern coding agents like Cline and Claude Code, statistical analysis, and experiment tracking with MLflow. ## Related Videos - [Evolving the developer experience in the age of AI](https://www.wearedevelopers.com/videos/100201-evolving-the-developer-experience-in-the-age-of-ai) - [Green Cloud Computing](https://www.wearedevelopers.com/videos/592-green-cloud-computing) - [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data) - [WebAssembly: The Next Frontier of Cloud Computing](https://www.wearedevelopers.com/videos/972-webassembly-the-next-frontier-of-cloud-computing) - [AI Pair Programming with GitHub Copilot at SAP: Looking Back, Looking Forward!](https://www.wearedevelopers.com/videos/1546-ai-pair-programming-with-github-copilot-at-sap-looking-back-looking-forward) - [Build a CI/CD pipeline to automate code reviews and ensure code quality](https://www.wearedevelopers.com/videos/349-build-a-ci-cd-pipeline-to-automate-code-reviews-and-ensure-code-quality) ## Related Articles - [System change: restart as developer?](https://www.wearedevelopers.com/magazine/39-system-change-restart-as-developer) - [Starter Kit For Job Applications For Developers](https://www.wearedevelopers.com/magazine/7-starter-kit-for-job-applications-for-developers) - [Best Coding Boot Camps in Germany](https://www.wearedevelopers.com/magazine/237-best-coding-boot-camps-in-germany) - [Where to Find Entry-Level Software Engineering Jobs](https://www.wearedevelopers.com/magazine/397-where-to-find-entry-level-software-engineering-jobs) - [Top 6 Hackathons for Developers in 2023](https://www.wearedevelopers.com/magazine/263-top-6-hackathons-for-developers-in-2023) - [Finding Jobs in Germany](https://www.wearedevelopers.com/magazine/375-finding-jobs-in-germany)