Combining Geometric, Textual and Visual Features for Predicting Prepositions in Image Descriptions

Arnau Ramisa Josiah Wang Ying Lu 1 Emmanuel Dellandréa 1 Francesc Moreno-Noguer 2 Robert Gaizauskas
1 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
2 CSIC-UPC - Institut de Robotica i Informatica Industrial [Barcelona]
Abstract : We investigate the role that geometric, textual and visual features play in the task of predicting a preposition that links two visual entities depicted in an image. The task is an important part of the subsequent process of generating image descriptions. We explore the prediction of prepositions for a pair of entities, both in the case when the labels of such entities are known and unknown. In all situations we found clear evidence that all three features contribute to the prediction task.
Type de document :
Communication dans un congrès
Conference on Empirical Methods in Natural Language Processing, Sep 2015, Lisbon, Portugal. pp.214-220, 2015
Liste complète des métadonnées
https://hal.archives-ouvertes.fr/hal-01375638
Contributeur : Emmanuel Dellandrea <>
Soumis le : lundi 3 octobre 2016 - 13:12:52
Dernière modification le : jeudi 19 avril 2018 - 14:38:06

Identifiants

  • HAL Id : hal-01375638, version 1

Collections

EC-LYON | UNIV-LYON2 | LIRIS | INSA-LYON | UNIV-LYON1

Citation

Arnau Ramisa, Josiah Wang, Ying Lu, Emmanuel Dellandréa, Francesc Moreno-Noguer, et al.. Combining Geometric, Textual and Visual Features for Predicting Prepositions in Image Descriptions. Conference on Empirical Methods in Natural Language Processing, Sep 2015, Lisbon, Portugal. pp.214-220, 2015. 〈hal-01375638〉

Exporter

BibTeX TEI DC DCterms EndNote

Partager

Métriques

Consultations de la notice

148

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD