Alzheimer’s Dementia Detection Using Acoustic & Linguistic Features and Pre-trained BERT

Akshay Valsaraj , Ithihas Madala , Nikhil Garg (1, 2, 3) , Veeky Baths

1 ICSI - International Computer Science Institute [Berkeley]
2 NCM - IEMN - Nanostructures, nanoComponents & Molecules - IEMN
3 IEMN - Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520

Alzheimer’s disease is a fatal progressive brain disorder that worsens with time. It is high time we have inexpensive and quick clinical diagnostic techniques for early detection and care. In previous studies, various Machine Learning techniques and Pre-trained Deep Learning models have been used in conjunction with the extraction of various acoustic and linguistic features. Our study focuses on three models for the classification task in the ADReSS (The Alzheimer’s Dementia Recognition through Spontaneous Speech) 2021 Challenge. We use the well-balanced dataset provided by the ADReSS Challenge for training and validating our models. Model 1 uses various acoustic features from the eGeMAPs feature-set, Model 2 uses various linguistic features that we generated from auto-generated transcripts and Model 3 uses the auto-generated transcripts directly to extract features using a Pre-trained BERT and TF-IDF. These models are described in detail in the models section.

Mots clés: Speech Recognition; Human-Computer-Interaction; Computational Para-linguistics

Domaines: Sciences de l'ingénieur [physics]

Akshay Valsaraj, Ithihas Madala, Nikhil Garg, Veeky Baths. Alzheimer’s Dementia Detection Using Acoustic & Linguistic Features and Pre-trained BERT. 2021 8th International Conference on Soft Computing & Machine Intelligence (ISCMI), Nov 2021, Cario, Egypt. pp.171-175, ⟨10.1109/ISCMI53840.2021.9654804⟩. ⟨hal-03666188⟩