Exploring Eco-Acoustic Data with K-Determinantal Point Processes

Mohamed Outidrarine (1) , Pierre Baudet (1) , Vincent Lostanlen (1) , Mathieu Lagrange (1) , Juan Sebastián Ulloa (2)

1 LS2N - Laboratoire des Sciences du Numérique de Nantes
2 Instituto de Investigación de Recursos Biológicos Alexander von Humboldt = Alexander von Humboldt Biological Resources Research Institute

The deployment of acoustic sensor networks in a natural environment contributes to the understanding and the conservation of biodiversity. Yet, the sheer size of audio data which result from these recordings prevents listening them in full. In order to skim through an ecoacoustic corpus, one may typically draw K snippets uniformly at random. In this article, we present an alternative method, based on K-determinantal point processes (K-DPP). This method weights the sampling of K-tuples according to a twofold criterion of relevance and diversity. To study the eco-acoustics of a tropical dry forest in Colombia, we define relevance in terms of time-frequency second derivative (TFSD) and diversity in terms of scattering transform. Hence, we show that K-DPP offers a better tradeoff than K-means clustering. Furthermore, we estimate the species richness of the K selected snippets by means of the BirdNET birdsong classifier, which is based on a deep neural network. We find that, for K > 10, K-DPP and K-means tend to produce a species checklist that is richer than sampling K snippets independently without replacement.

Mots clés: Acoustic sensor networks; Bird species classification; Scattering transform; Time-frequency second derivative

Domaines: Son [cs.SD]

Mohamed Outidrarine, Pierre Baudet, Vincent Lostanlen, Mathieu Lagrange, Juan Sebastián Ulloa. Exploring Eco-Acoustic Data with K-Determinantal Point Processes. International Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE), 2022, Nancy, France. ⟨hal-03829922⟩