Skip to Main content Skip to Navigation
Conference papers

Learning grounded word meaning representations on similarity graphs

Abstract : This paper introduces a novel approach to learn visually grounded meaning representations of words as low-dimensional node embeddings on an underlying graph hierarchy. The lower level of the hierarchy models modality-specific word representations through dedicated but communicating graphs, while the higher level puts these representations together on a single graph to learn a representation jointly from both modalities. The topology of each graph models similarity relations among words, and is estimated jointly with the graph embedding. The assumption underlying this model is that words sharing similar meaning correspond to communities in an underlying similarity graph in a lowdimensional space. We named this model Hierarchical Multi-Modal Similarity Graph Embedding (HM-SGE). Experimental results validate the ability of HM-SGE to simulate human similarity judgements and concept categorization, outperforming the state of the art. 1 * Work done during an internship at the IRI (CSIC-UPC).
Document type :
Conference papers
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03381921
Contributor : Herwig Wendt Connect in order to contact the contributor
Submitted on : Monday, October 18, 2021 - 9:42:01 AM
Last modification on : Monday, October 25, 2021 - 9:58:10 AM

File

emnlp2021.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03381921, version 1
  • ARXIV : 2109.03084

Citation

Mariella Dimiccoli, Herwig Wendt, Pau Batlle. Learning grounded word meaning representations on similarity graphs. Conference on Empirical Methods in Natural Language Processing (EMNLP 2021), Nov 2021, Punta Cana, Dominican Republic. ⟨hal-03381921⟩

Share

Metrics

Record views

47

Files downloads

42