Retinal noise emulation: a novel artistic tool for cinema that also improves compression efficiency

Mostra el registre complet Registre parcial de l'ítem

• dc.contributor.author Zabaleta, Itziar
• dc.contributor.author Cámara, Mateo
• dc.contributor.author Díaz, César
• dc.contributor.author Canham, Trevor
• dc.contributor.author García, Narciso
• dc.contributor.author Bertalmío, Marcelo
• dc.date.accessioned 2020-11-04T09:33:46Z
• dc.date.available 2020-11-04T09:33:46Z
• dc.date.issued 2020
• dc.description.abstract In cinema it is standard practice to improve the appearance of images by adding noise that simulates film grain. This is computationally very costly, so it is only done in post-production and not on the set. It is also limiting because the artists are not able to really experiment with the noise nor introduce novel looks. Furthermore, video compression requires a higher bit rate when the source material has film grain or any other type of high frequency texture. In this work, we introduce a method for adding texture to digital cinema that aims to solve these problems. The proposed algorithm is based on modeling retinal noise, with which the images processed by our method have a natural appearance. This “retinal grain” serves a double purpose. One is aesthetic, as it has parameters that allow to vary widely the resulting texture appearance, which make it an artistic tool for cinematographers. Results are validated through psychophysical experiments in which observers, including cinema professionals, prefer our method over film grain synthesis methods from academia and the industry. The other purpose of the retinal noise emulation method is to improve the quality of compressed video by masking compression artifacts, which allows to lower the encoding bit rate while preserving image quality, and to improve image quality while keeping the bit rate fixed. The effectiveness of our approach for improving coding efficiency, with average bit rate savings of 22.5%, has been validated through psychophysical experiments using professional cinema content shot in 4K, color-graded and where the amount of retinal noise was selected by a motion picture specialist based solely on aesthetic preference.en
• dc.description.sponsorship This work was supported in part by the European Union through the Horizon 2020 Research and Innovation Programme (Project HDR4EU) under Grant 761544 and (Project SAUCE) Grant 780470, and in part by the Spanish Government, Ministerio de Economía, Industria y Competitividad (AEI/FEDER), under Project TEC2016-75981 (IVME) and Project PGC2018-099651-B-I00.
• dc.format.mimetype application/pdf
• dc.identifier.citation Zabaleta I, Cámara M, Díaz C, Canham T, García N, Bertalmío M. Retinal noise emulation: a novel artistic tool for cinema that also improves compression efficiency. IEEE Access. 2020 Apr 1;8:67263-76. DOI: 10.1109/ACCESS.2020.2984994
• dc.identifier.doi http://dx.doi.org/10.1109/ACCESS.2020.2984994
• dc.identifier.issn 2169-3536
• dc.identifier.uri http://hdl.handle.net/10230/45654
• dc.language.iso eng
• dc.publisher Institute of Electrical and Electronics Engineers (IEEE)
• dc.relation.ispartof IEEE Access. 2020 Apr 1;8:67263-76
• dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/761544
• dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/780470
• dc.relation.projectID info:eu-repo/grantAgreement/ES/1PE/TEC2016-75981
• dc.relation.projectID info:eu-repo/grantAgreement/ES/2PE/PGC2018-099651-B-I00
• dc.rights This work is licensed under a Creative Commons Attribution 4.0 License. https://creativecommons.org/licenses/by/4.0/
• dc.rights.accessRights info:eu-repo/semantics/openAccess
• dc.rights.uri https://creativecommons.org/licenses/by/4.0/
• dc.subject.keyword Image enhancementen
• dc.subject.keyword Noiseen
• dc.subject.keyword Image perceptionen
• dc.subject.keyword Vision modelsen
• dc.subject.keyword QoEen
• dc.subject.keyword Video compressionen
• dc.subject.keyword Adaptive streamingen
• dc.title Retinal noise emulation: a novel artistic tool for cinema that also improves compression efficiencyen
• dc.type info:eu-repo/semantics/article
• dc.type.version info:eu-repo/semantics/publishedVersion