Modeling instrumental activities of daily living in egocentric vision as sequences of active objects and context for alzheimer disease research

Iván González-Díaz 1 Vincent Buso 1 Jenny Benois-Pineau 1 Guillaume Bourmaud 2 Rémi Megret 2
1 LaBRI - Laboratoire Bordelais de Recherche en Informatique
2 IMS - Laboratoire de l'intégration, du matériau au système
Abstract : In this paper we study the problem of recognizing Instrumental Activities of Daily Living (IADL) in egocentric camera view. The target application of this research is the indexing of videos of patients with Alzehimer disease, thus providing medical staff with fast access and easy navigation through the video contents and helping them while assessing patients' abilities to perform IADL. Driven by the consideration that an activity in egocentric videos can be defined as a sequence of interacted objects inside different rooms, we present a novel representation based on the output of object and room detectors over temporal segments. In addition, our object detection approach is extended by automatic detection of visually salient regions since distinguishing active objects from context has been proven to dramatically improve performances in egocentric ADL recognition. We have assessed our proposal on a publicly available egocentric dataset and show extensive experimental results that demonstrate our approach outperforms current state of the art for unconstrained scenarios in which training and testing environments may be notably different.
Document type :
Conference papers
Complete list of metadatas
https://hal.archives-ouvertes.fr/hal-01437429
Contributor : Jenny Benois-Pineau <>
Submitted on : Tuesday, January 17, 2017 - 11:13:33 AM
Last modification on : Thursday, January 11, 2018 - 6:21:09 AM

Identifiers

Collections

UNIV-BORDEAUX | IMS-BORDEAUX-FUSION | IMS-BORDEAUX | LABRI

Citation

Iván González-Díaz, Vincent Buso, Jenny Benois-Pineau, Guillaume Bourmaud, Rémi Megret. Modeling instrumental activities of daily living in egocentric vision as sequences of active objects and context for alzheimer disease research. Proceedings of the 1st ACM international workshop on Multimedia indexing and information retrieval for healthcare, Oct 2013, Barcelone, Spain. pp.11-14 ⟨10.1145/2505323.2505328⟩. ⟨hal-01437429⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

144

Contact

CCSD