Hierarchical Hidden Markov Model in Detecting Activities of Daily Living in Wearable Videos for Studies of Dementia

Abstract : This paper presents a method for indexing activities of daily living in videos obtained from wearable cameras. In the context of dementia diagnosis by doctors, the videos are recorded at patients' houses and later visualized by the medical practitioners. The videos may last up to two hours, therefore a tool for an efficient navigation in terms of activities of interest is crucial for the doctors. The specific recording mode provides video data which are really difficult, being a single sequence shot where strong motion and sharp lighting changes often appear. Our work introduces an automatic motion based segmentation of the video and a video structuring approach in terms of activities by a hierarchical two-level Hidden Markov Model. We define our description space over motion and visual characteristics of video and audio channels. Experiments on real data obtained from the recording at home of several patients show the difficulty of the task and the promising results of our approach.
Document type :
Journal articles
Complete list of metadatas

Cited literature [31 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00639014
Contributor : Svebor Karaman <>
Submitted on : Tuesday, April 8, 2014 - 3:01:20 PM
Last modification on : Thursday, October 24, 2019 - 2:44:06 PM
Long-term archiving on : Tuesday, July 8, 2014 - 12:00:40 PM

File

MTAP-Karaman2012OA.pdf
Files produced by the author(s)

Identifiers

Citation

Svebor Karaman, Jenny Benois-Pineau, Vladislavs Dovgalecs, Rémi Mégret, Julien Pinquier, et al.. Hierarchical Hidden Markov Model in Detecting Activities of Daily Living in Wearable Videos for Studies of Dementia. Multimedia Tools and Applications, Springer Verlag, 2014, 69 (3), pp.743-771. ⟨10.1007/s11042-012-1117-x⟩. ⟨hal-00639014v2⟩

Share

Metrics

Record views

491

Files downloads

386