Using Elasticsearch for Linguistic Analysis of Tweets in Time and Space

Adrien Barbaresi (1) , Antonio Ruiz Tinoco (2)

1 ÖAW - Osterreichische Akademie der Wissenschaften
2 Sophia University [Tokyo]

The collection and analysis of microtexts is both straightforward from a computational viewpoint and complex in a scientific perspective, they often feature non-standard data and are accompanied by a profusion of metadata. We address corpus construction and visualization issues in order to study spontaneous speech and variation through short messages. To this end, we introduce an experimental setting based on a generic NoSQL database (Elasticsearch) and its front-end (Kibana). We focus on Spanish and German and present concrete examples of faceted searches on short messages coming from the Twitter platform. The results are discussed with a particular emphasis on the impact of querying and visualization techniques first for longitudinal studies in the course of time and second for results aggregated in a spatial perspective.

Mots clés: Social media; Twitter; NoSQL databases; Time series; Spatial data mining

Domaines: Linguistique; Informatique et langage [cs.CL]

Adrien Barbaresi, Antonio Ruiz Tinoco. Using Elasticsearch for Linguistic Analysis of Tweets in Time and Space. LREC 2018, May 2018, Miyazaki, Japan. pp.14-19. ⟨hal-01798706⟩