Vision models fine-tuned by cinema professionals for High Dynamic Range imaging in movies

Mostra el registre complet Registre parcial de l'ítem

  • dc.contributor.author Cyriac, Praveen
  • dc.contributor.author Canham, Trevor
  • dc.contributor.author Kane, David
  • dc.contributor.author Bertalmío, Marcelo
  • dc.date.accessioned 2020-10-07T07:44:49Z
  • dc.date.available 2020-10-07T07:44:49Z
  • dc.date.issued 2020
  • dc.description.abstract Many challenges that deal with processing of HDR material remain very much open for the film industry, whose extremely demanding quality standards are not met by existing automatic methods. Therefore, when dealing with HDR content, substantial work by very skilled technicians has to be carried out at every step of the movie production chain. Based on recent findings and models from vision science, we propose in this work effective tone mapping and inverse tone mapping algorithms for production, post-production and exhibition. These methods are automatic and real-time, and they have been both fine-tuned and validated by cinema professionals, with psychophysical tests demonstrating that the proposed algorithms outperform both the academic and industrial state-of-the-art. We believe these methods bring the field closer to having fully automated solutions for important challenges for the cinema industry that are currently solved manually or sub-optimally. Another contribution of our research is to highlight the limitations of existing image quality metrics when applied to the tone mapping problem, as none of them, including two state-of-the-art deep learning metrics for image perception, are able to predict the preferences of the observers.en
  • dc.description.sponsorship This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement number 761544 (project HDR4EU) and under grant agreement number 780470 (project SAUCE), and by the Spanish government and FEDER Fund, grant ref. PGC2018-099651-B-I00 (MCIU/AEI/FEDER, UE). We’re very grateful to Albert Pascual, Brett Harrison, Stephane Cattan and everyone at Deluxe-Spain, Alejandro Matus and everyone at Moonlight Barcelona, for their help in fine-tuning and validating our method.
  • dc.format.mimetype application/pdf
  • dc.identifier.citation Cyriac P, Canham T, Kane D, Bertalmío M. Vision models fine-tuned by cinema professionals for High Dynamic Range imaging in movies. Multimed Tools Appl. 2020 Sep 15;80:2537–63. DOI: 10.1007/s11042-020-09532-y
  • dc.identifier.doi http://dx.doi.org/10.1007/s11042-020-09532-y
  • dc.identifier.issn 1380-7501
  • dc.identifier.uri http://hdl.handle.net/10230/45415
  • dc.language.iso eng
  • dc.publisher Springer
  • dc.relation.ispartof Multimedia Tools and Applications. 2020 Sep 15;80:2537–63
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/761544
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/780470
  • dc.relation.projectID info:eu-repo/grantAgreement/ES/2PE/PGC2018-099651-B-I00
  • dc.rights This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
  • dc.rights.accessRights info:eu-repo/semantics/openAccess
  • dc.rights.uri http://creativecommons.org/licenses/by/4.0/
  • dc.subject.keyword High dynamic rangeen
  • dc.subject.keyword Vision modelsen
  • dc.subject.keyword Visual perceptionen
  • dc.subject.keyword Tone mappingen
  • dc.subject.keyword Inverse tone mappingen
  • dc.subject.keyword Cinema post-productionen
  • dc.title Vision models fine-tuned by cinema professionals for High Dynamic Range imaging in moviesen
  • dc.type info:eu-repo/semantics/article
  • dc.type.version info:eu-repo/semantics/publishedVersion