Interpreting Strokes on Paper with a Mobile Assistant

Theophanis Tsandilas 1, 2
1 IN-SITU - Situated interaction
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : Digital pen technology has allowed for the easy transfer of pen data from paper to the computer. However, linking handwritten content with the digital world remains a hard problem as it requires the translation of unstructured and highly personal vocabularies into structured ones that computers can easily understand and process. Automatic recognition can help to this direction, but as it is not always reliable, solutions require the active cooperation between users and recognition algorithms. This work examines the use of portable touch-screen devices in connection with pen and paper to help users direct and refine the interpretation of their strokes on paper. We explore four techniques of bimanual interaction that combine touch and pen-writing, where user attention is divided between the original strokes on paper and their interpretation by the electronic device. We demonstrate the techniques through a mobile interface for writing music that complements the automatic recognition with interactive user-driven interpretation. An experiment evaluates the four techniques and provides insights about their strengths and limitations.
Type de document :
Communication dans un congrès
UIST - 25th Symposium on User Interface Software and Technology - 2012, Oct 2012, Cambridge, MA, United States. ACM, pp.299-308, 2012
Liste complète des métadonnées

Littérature citée [26 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-00722810
Contributeur : Theophanis Tsandilas <>
Soumis le : samedi 4 août 2012 - 11:32:16
Dernière modification le : jeudi 5 avril 2018 - 12:30:12
Document(s) archivé(s) le : vendredi 16 décembre 2016 - 04:52:17

Fichier

uist2012-hal.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-00722810, version 1

Collections

Citation

Theophanis Tsandilas. Interpreting Strokes on Paper with a Mobile Assistant. UIST - 25th Symposium on User Interface Software and Technology - 2012, Oct 2012, Cambridge, MA, United States. ACM, pp.299-308, 2012. 〈hal-00722810〉

Partager

Métriques

Consultations de la notice

361

Téléchargements de fichiers

647