Models of semantic representation with visual attribute

Silberer, Carina; Ferrari, Vittorio; Lapata, Mirella

Models of semantic representation with visual attribute

Llicència

Citació

Silberer C, Ferrari V, Lapata M. Models of semantic representation with visual attribute. In: Schuetze H, Fung P, Poesio M, editors. Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2013 Aug 4-9; Sofia, Bulgaria. Stroudsburg: ACL; 2013. p. 572-82.

Resum

We consider the problem of grounding the meaning of words in the physical world and focus on the visual modality which we represent by visual attributes. We create a new large-scale taxonomy of visual attributes covering more than 500 concepts and their corresponding 688K images. We use this dataset to train attribute classifiers and integrate their predictions with text-based distributional models of word meaning. We show that these bimodal models give a better fit to human word association data compared to amodal models and word representations based on handcrafted norming data.

Descripció

Comunicació presentada a: the 51st Annual Meeting of the Association for Computational Linguistics, celebrat del 4 al 9 d'agost de 2013 a Sofia, Bulgària.