Skip to Main content Skip to Navigation
Conference papers

Integrating Perceptual Signal Features within a Multi-facetted Conceptual Model for Automatic Image Retrieval

Abstract : The majority of the content-based image retrieval (CBIR) systems are restricted to the representation of signal aspects, e.g. color, texture... without explicitly considering the semantic content of images. According to these approaches a sun, for example, is represented by an orange or yellow circle, but not by the term "sun". The signal-oriented solutions are fully automatic, and thus easily usable on substantial amounts of data, but they do not fill the existing gap between the extracted low-level features and semantic descriptions. This obviously penalizes qualitative and quantitative performances in terms of recall and precision, and therefore users' satisfaction. Another class of methods, which were tested within the framework of the Fermi-GC project, consisted in modeling the content of images following a sharp process of human-assisted indexing. This approach, based on an elaborate model of representation (the conceptual graph formalism) provides satisfactory results during the retrieval phase but is not easily usable on large collections of images because of the necessary human intervention required for indexing. The contribution of this paper is twofold: in order to achieve more efficiency as far as user interaction is concerned, we propose to highlight a bond between these two classes of image retrieval systems and integrate signal and semantic features within a unified conceptual framework. Then, as opposed to state-of-the-art relevance feedback systems dealing with this integration, we propose a representation formalism supporting this integration which allows us to specify a rich query language combining both semantic and signal characterizations. We will validate our approach through quantitative (recall-precision curves) evaluations.
Document type :
Conference papers
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download

https://hal.inria.fr/hal-00953926
Contributor : Marie-Christine Fauvet Connect in order to contact the contributor
Submitted on : Monday, March 3, 2014 - 12:53:20 PM
Last modification on : Tuesday, December 8, 2020 - 10:42:35 AM
Long-term archiving on: : Saturday, May 31, 2014 - 10:50:57 AM

File

ECIR2004_belkhatir.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00953926, version 1

Collections

Citation

Mohammed Belkhatir, Philippe Mulhem, Yves Chiaramella. Integrating Perceptual Signal Features within a Multi-facetted Conceptual Model for Automatic Image Retrieval. ECIR, 2004, Sunderland, United Kingdom. pp.267--282. ⟨hal-00953926⟩

Share

Metrics

Record views

300

Files downloads

327