Mobile museum guide based on fast SIFT recognition

Boris Ruf , Effrosyni Kokiopoulou , Marcin Detyniecki (1)

1 MALIRE - Machine Learning and Information Retrieval

This article explores the feasibility of a market-ready, mobile pattern recognition system based on the latest findings in the field of object recognition and currently available hardware and network technology. More precisely, an innovative, mobile museum guide system is presented, which enables camera phones to recognize paintings in art galleries.After careful examination, the algorithms Scale-Invariant Feature Transform (SIFT) and Speeded Up Robust Features (SURF) were found most promising for this goal. Consequently, both have been integrated in a fully implemented prototype system and their performance has been thoroughly evaluated under realistic conditions.In order to speed up the matching process for finding the corresponding sample in the feature database, an approximation to Nearest Neighbor Search was investigated. The k-means based clustering approach was found to significantly improve the computational time.

Domaines: Informatique [cs]

Boris Ruf, Effrosyni Kokiopoulou, Marcin Detyniecki. Mobile museum guide based on fast SIFT recognition. International workshop on Adaptive Multimedia Retrieval, Jun 2008, Berlin, Germany. pp.170-183, ⟨10.1007/978-3-642-14758-6_14⟩. ⟨hal-01304999⟩