Working Student - AI-based Quality Evaluation for AI-Generated Code Changes (SAP HANA Cloud)

In their day-to-day development, SAP HANA developers review code changes generated by AI coding agents. These changes must meet high quality standards before they can be merged into production code.

Today, we verify that AI-generated code passes determistic verification (e.g. linting, tests) but we don't yet measure whether changes fulfill other criteria (e.g code conventions). This can lead to a lower acceptance of AI-generated changes.

In this project you design and run experiments to evaluate an automated quality evaluation system that uses large language models and techniques like LLM-as-a-Judge to assess AI-generated changes. You build a ground-truth dataset from real developer review feedback, design a structured scoring rubric, and benchmark how well an LLM judge correlates with human decisions. The project is implemented in Python and makes use of modern coding agents like Cline and Claude Code, statistical analysis, and experiment tracking with MLflow.

Do you have experience in SAP HANA?, Do you have a Master's degree?, * Student of computer science, data science, computer linguistics, mathematics or related field at a higher education institution

• Experience with programming, machine learning and LLMs, demonstrated by existing projects.
• Comfortable with English for daily communication (B level). German (B level) is a plus.
• Good grades shown by a Transcript of Records (ToR) / Grades

The application must contain (English or German):

• A cover letter that expresses your interest
• A CV that provides information about your programming experience
• A transcript of records (ToR) that contains grades of all university-level courses/degrees

Where you belong

Join a team that values creativity, encourages risk-taking, and counts on your unique ideas. Our goal is to build and maintain a state-of-the-art agentic AI coding platform for SAP HANA.

Your set of application documents should contain a cover letter, a resume in table form, school leaving certificates, certificate of enrollment, current university transcript of records, copies of any academic degrees already earned, and if available, references from former employers (including internships). Please also describe your experience and skills in foreign languages and computer programs / programming languages.

This is a SAP global, strategic, paid working student position that provides students with opportunities to find purpose in their careers.

At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work. We offer a highly collaborative, caring team environment with a strong focus on learning and development, recognition for your individual contributions, and a variety of benefit options for you to choose from., SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best. We win with inclusion SAP's culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone - regardless of background - feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better and more equitable world. SAP is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to the values of Equal Employment Opportunity and provide accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com. For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.