A General Audio Semantic Classifier based on human perception motivated mode

Abstract : The audio channel conveys rich clues for content-based multimedia indexing. Interesting audio analysis includes, besides widely known speech recognition and speaker identification problems, speech/music segmentation, speaker gender detection, special effect recognition such as gun shots or car pursuit, and so on. All these problems can be considered as an audio classification problem which needs to generate a label from low audio signal analysis. While most audio analysis techniques in the literature are problem specific, we propose in this paper a general framework for audio classification. The proposed technique uses a perceptually motivated model of the human perception of audio classes in the sense that it makes a judicious use of certain psychophysical results and relies on a neural network for classification. In order to assess the effectiveness of the proposed approach, large experiments on several audio classification problems have been carried out, including speech/music discrimination in Radio/TV programs, gender recognition on a subset of the switchboard database, highlights detection in sports videos, and musical genre recognition. The classification accuracies of the proposed technique are comparable to those obtained by problem specific techniques while offering the basis of a general approach for audio classification.
Document type :
Journal articles
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01589771
Contributor : Équipe Gestionnaire Des Publications Si Liris <>
Submitted on : Tuesday, September 19, 2017 - 9:20:56 AM
Last modification on : Thursday, November 21, 2019 - 2:28:38 AM

Links full text

Identifiers

Citation

Hadi Harb, Liming Chen. A General Audio Semantic Classifier based on human perception motivated mode. Multimedia Tools and Applications, Springer Verlag, 2007, 3, 34, pp.375-395. ⟨10.1007/s11042-007-0108-9⟩. ⟨hal-01589771⟩

Share

Metrics

Record views

105