Sugito, YasukoBertalmío, Marcelo2020-10-192020Sugito Y, Bertalmío M. Non-experts or experts? Statistical analyses of MOS using DSIS method. In: 2020 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP); 2020 May 4-8; Barcelona, Spain. New Jersery: The Institute of Electrical and Electronics Engineers; 2020. p. 2732-36. DOI: 10.1109/ICASSP40776.2020.90529062379-190Xhttp://hdl.handle.net/10230/45507Comunicació presentada a: 2020 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), celebrada a Barcelona (Espanya) del 4 a 8 de maig de 2020.In image quality assessments, the results of subjective evaluation experiments that use the double-stimulus impairment scale (DSIS) method are often expressed in terms of the mean opinion score (MOS), which is the average score of all subjects for each test condition. Some MOS values are used to derive image quality criteria, and it has been assumed that it is preferable to perform tests with non-expert subjects rather than with experts. In this study, we analyze the results of several subjective evaluation experiments using the DSIS method. Our first contribution is to discuss the statistical meaning of the MOS values, which has not been previously addressed in the literature. Second, our results show that, contrary to the established belief, there are advantages when performing subjective tests with experts, in that they allow experiments to be performed with fewer subjects, and to better determine the lower threshold of image quality.application/pdfeng© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. http://dx.doi.org/10.1109/ICASSP40776.2020.9052906info:eu-repo/semantics/conferenceObjecthttp://dx.doi.org/10.1109/ICASSP40776.2020.9052906The double-stimulus impairment scale (DSIS) methodMean opinion score (MOS)Non-expertExpertStatistical analysisinfo:eu-repo/semantics/openAccess