Automatic evaluation of continuous assessment tests

Abstract

The UOC is an online university where students follow an online continuous assessment system in order to successfully complete their studies. Due to the growing number of students, the task of marking their assessment tests has become tedious and time-consuming. In order to speed up and standardise the task, the UOC started to develop a pre-evaluation system to provide a preliminary, automatic evaluation of the tests by using the latent semantic analysis technique. Given a set of ideal reference answers for the evaluation tests, the students’ answers are evaluated with respect to the reference, providing an estimated score. This paper shows some preliminar results, from which we can conclude that the correlation between automatic and human evaluations is higher and statistically significant when both the math formulas codification and the language used by the students are the same than in the reference answers.