ITMO Master’s Students Create Homework-Checker AI Assistant for Avito

Avito Education offers programs in which students submit not only text responses, but also code, technical solutions, and product case analyses. Avito specialists and invited experts assess these assignments manually based on a set of criteria; Avito AI Reviewer is meant to take on the preliminary analysis and distribution between human reviewers.

This case, suggested by the company, was featured at the recent AI Product Hack hackathon. 12 teams worked on their solutions, allowing the company to compare various product and technical approaches within a single week. The winning prototype was developed by Master’s students Anna Kurdina, Nikita Koshelev, and Ivan Chernov.

The team’s solution involved the entire assessment cycle: assignment of experts, evaluation of submissions against criteria, suggestion of comprehension questions, and suppor of the expert’s final decision. Once a student submits their response, the system assigns an expert based on their specialization and workload. The AI evaluates the assignment against the given criteria, marks controversial points, and drafts an evaluation. Next, the expert verifies the system’s conclusions and gives the final grade. During the internal test, the service prepared such a preliminary report for one submission in an average of 82.9 seconds, with the cost of 0.41 rubles per run.

This result demonstrates that part of the assessment, including criteria-based evaluation and preparing tips for experts, can be automated quickly and at low expense. Currently, Avito experts spend around 5-10 hours on homework assessment a week. The suggested service can potentially decrease the time for preliminary submission analysis. Over the course of the ongoing semester, the students will continue working on the prototype and testing its performance on a real cohort with Avito

“We were happy to see how different and thorough the suggested solutions were. We hope that we will be able to work together with the teams to turn the best ideas into finished products and introduce them into our daily work,” shares Daria Korshunova, an educational projects producer at Avito.