Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

A pilot study on Mandarin Cued Speech

Abstract : Cued Speech (CS) is a communication system developed for deaf people, which exploits hand cues to complement speechreading at the phonetic level. Currently, it is estimated that CS has been adapted to over 60 languages; however, no official CS system is available for Mandarin Chinese. This article proposes a novel and efficient Mandarin Chinese CS system, satisfying the main criterion that the hand coding constitutes a complement to the lips’ movements. We propose to code vowels [i, u, y] as semiconsonants when they are followed by other Mandarin finals, which reduces the number of Mandarin finals to be coded from 36 to 16. We establish a coherent similarity between Mandarin Chinese and French vowels for the remaining 16 finals/vowels, which allows us to take advantage of the French CS system. Furthermore, by investigating the lips viseme distribution based on a new corpus, an optimal allocation of the 16 Mandarin vowels to different hand positions is obtained. A Gaussian classifier was used to evaluate the average separability of different allocated vowel groups, which gives 92.08%, 92.33%, and 92.73% for the three speakers, respectively. The consonants are mainly designed according to their similarities with the French CS system, as well as some considerations on the special Mandarin consonants. In our system, the tones of Mandarin are coded with head movements.
Document type :
Preprints, Working Papers, ...
Complete list of metadatas

Cited literature [43 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01845295
Contributor : Li Liu <>
Submitted on : Monday, January 6, 2020 - 2:17:55 AM
Last modification on : Thursday, September 24, 2020 - 9:00:02 AM
Long-term archiving on: : Tuesday, April 7, 2020 - 7:03:53 PM

File

05_Liu_compressed.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01845295, version 2

Collections

Citation

Li Liu, Gang Feng. A pilot study on Mandarin Cued Speech. 2020. ⟨hal-01845295v2⟩

Share

Metrics

Record views

51

Files downloads

92