Skip to Main content Skip to Navigation
Conference papers

Interpreting Strokes on Paper with a Mobile Assistant

Theophanis Tsandilas 1, 2
1 IN-SITU - Situated interaction
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : Digital pen technology has allowed for the easy transfer of pen data from paper to the computer. However, linking handwritten content with the digital world remains a hard problem as it requires the translation of unstructured and highly personal vocabularies into structured ones that computers can easily understand and process. Automatic recognition can help to this direction, but as it is not always reliable, solutions require the active cooperation between users and recognition algorithms. This work examines the use of portable touch-screen devices in connection with pen and paper to help users direct and refine the interpretation of their strokes on paper. We explore four techniques of bimanual interaction that combine touch and pen-writing, where user attention is divided between the original strokes on paper and their interpretation by the electronic device. We demonstrate the techniques through a mobile interface for writing music that complements the automatic recognition with interactive user-driven interpretation. An experiment evaluates the four techniques and provides insights about their strengths and limitations.
Complete list of metadatas

Cited literature [26 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00722810
Contributor : Theophanis Tsandilas <>
Submitted on : Saturday, August 4, 2012 - 11:32:16 AM
Last modification on : Tuesday, April 21, 2020 - 1:07:12 AM
Document(s) archivé(s) le : Friday, December 16, 2016 - 4:52:17 AM

File

uist2012-hal.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00722810, version 1

Collections

Citation

Theophanis Tsandilas. Interpreting Strokes on Paper with a Mobile Assistant. UIST - 25th Symposium on User Interface Software and Technology - 2012, Oct 2012, Cambridge, MA, United States. pp.299-308. ⟨hal-00722810⟩

Share

Metrics

Record views

404

Files downloads

883