A Model-based Heuristic Evaluation Method of Exploratory Search

Emilie Palagi (1, 2) , Fabien Gandon (1, 2) , Alain Giboin (1, 2) , Raphaël Troncy (3)

1 WIMMICS - Web-Instrumented Man-Machine Interactions, Communities and Semantics
2 Laboratoire I3S - SPARKS - Scalable and Pervasive softwARe and Knowledge Systems
3 Eurecom [Sophia Antipolis]

A shortcoming of current evaluation methods of exploratory search engines is that they cannot be used to determine whether users' behaviours and exploratory search tasks are usefully supported. One main reason is that these methods rely on a loosely defined model of the exploratory search process. The aim of this paper is to propose a new model-based heuristic evaluation method of these systems. We present the approach used to design the heuristics of exploratory search and a checklist form for using them. The evaluation of the heuristics and its procedure demonstrates that they significantly help the users achieve an exploratory search system assessment.

Keywords: Exploratory Search Tasks; Heuristics; Evaluation methodology; Model-based method

Domains: Human-Computer Interaction [cs.HC]; Information Retrieval [cs.IR]

Emilie Palagi, Fabien Gandon, Alain Giboin, Raphaël Troncy. A Model-based Heuristic Evaluation Method of Exploratory Search. HCI 2018 - 32nd British Human Computer Interaction Conference, Jul 2018, Belfast, United Kingdom. pp.1-5. ⟨hal-01834292⟩