Photorealistic style transfer for video

Mostra el registre complet Registre parcial de l'ítem

  • dc.contributor.author Zabaleta, Itziar
  • dc.contributor.author Bertalmío, Marcelo
  • dc.date.accessioned 2022-05-17T06:00:33Z
  • dc.date.available 2022-05-17T06:00:33Z
  • dc.date.issued 2021
  • dc.description.abstract This work proposes an efficient example-based photorealistic style transfer algorithm for video. Given a source unprocessed video and a reference image color graded by an artist, we describe an automatic algorithm to transfer the visual style of the reference onto the source footage. Our approach builds upon the color transfer methods based on the statistical properties of images. These methods are fast and of low-complexity, therefore suitable for real-time implementations. Our contribution is to adapt those methods to be used for unprocessed video from cinema cameras, and optionally to incorporate regions of interest previously selected by the user, affecting the final color transfer. The resulting videos are free from artifacts and provide an excellent approximation to the intended look, bringing savings in pre-production, shooting and post-production time. Results are free of spatio-temporal artifacts and the method outperforms diverse state-of-the-art methods according to observer preference experiments.
  • dc.description.sponsorship This work has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement number 761544 (project HDR4EU) and under grant agreement number 780470 (project SAUCE), and by the Spanish government and FEDER Fund, grant ref. PGC2018-099651-B-I00 (MCIU/AEI/FEDER, UE).
  • dc.format.mimetype application/pdf
  • dc.identifier.citation Zabaleta I, Bertalmío M. Photorealistic style transfer for video. Signal Process Image Commun. 2021;95:116240. DOI: 10.1016/j.image.2021.116240
  • dc.identifier.doi http://doi.org/10.1016/j.image.2021.116240
  • dc.identifier.issn 0923-5965
  • dc.identifier.uri http://hdl.handle.net/10230/53109
  • dc.language.iso eng
  • dc.publisher Elsevier
  • dc.relation.ispartof Signal Processing Image Communication. 2021;95:116240.
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/761544
  • dc.relation.projectID info:eu-repo/grantAgreement/EC/H2020/780470
  • dc.relation.projectID info:eu-repo/grantAgreement/ES/1PE/PGC2018-099651-B-I00
  • dc.rights © 2021 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
  • dc.rights.accessRights info:eu-repo/semantics/openAccess
  • dc.rights.uri http://creativecommons.org/licenses/by-nc-nd/4.0/
  • dc.subject.keyword Image processing
  • dc.subject.keyword Computational photography
  • dc.subject.keyword Style transfer
  • dc.title Photorealistic style transfer for video
  • dc.type info:eu-repo/semantics/article
  • dc.type.version info:eu-repo/semantics/publishedVersion

Col·leccions

Articles (Departament de Tecnologies de la Informació i les Comunicacions)
Documents OpenAIRE (Open Access Infrastructure for Research in Europe)