Combining Multiple Sensors for Event Detection of Older People

Carlos F Crispim-Junior (1) , Qiao Ma (2) , Baptiste Fosty (1) , Rim Romdhane (1) , François Bremond (1) , Monique Thonnat (1)

1 STARS - Spatio-Temporal Activity Recognition Systems
2 Ecole Centrale de Pékin

We herein present a hierarchical model-based framework for event detection using multiple sensors. Event models combine a priori knowledge of the scene (3D geometric and semantic information, such as contextual zones and equipment) with moving objects (e.g., a Person) detected by a video monitoring system. The event models follow a generic ontology based on natural language, which allows domain experts to easily adapt them. The framework novelty lies on combining multiple sensors at decision (event) level, and handling their conflict using a proba-bilistic approach. The event conflict handling consists of computing the reliability of each sensor before their fusion using an alternative combination rule for Dempster-Shafer Theory. The framework evaluation is performed on multisensor recording of instrumental activities of daily living (e.g., watching TV, writing a check, preparing tea, organizing week intake of prescribed medication) of participants of a clinical trial for Alzheimer's disease study. Two fusion cases are presented: the combination of events (or activities) from heterogeneous sensors (RGB ambient camera and a wearable inertial sensor) following a deterministic fashion, and the combination of conflicting events from video cameras with partially overlapped field of view (a RGB-and a RGB-D-camera, Kinect). Results showed the framework improves the event detection rate in both cases.

Domaines: Informatique [cs]; Vision par ordinateur et reconnaissance de formes [cs.CV]

Carlos F Crispim-Junior, Qiao Ma, Baptiste Fosty, Rim Romdhane, François Bremond, et al.. Combining Multiple Sensors for Event Detection of Older People. 2015. ⟨hal-01854427⟩