Auditory, visual and auditory-visual identification of emotions by hearing and hearing-impaired adolescents

This study investigated the identification of nonverbal expressions of emotions by 19 hearing and 24 hearing-impaired adolescents. The participants were presented with video recordings of six emotions: anger, fear, sadness, surprise, happiness and disgust. The emotions were expressed on the same neutral sentence. The expressions were presented in three modes: visual, auditory and combined auditory-visual. The relative contributions of each mode to the identification processes were evaluated for the two research samples. The accuracy in identification of emotions through each of the presentation modes among the hearing-impaired participants was significantly lower than that of the hearing participants. The hearing participants performed better in the auditory-visual mode than in the auditory or the visual modes alone. The hearing-impaired participants performed better in the visual mode than in the auditory mode, and no difference was found between the auditory-visual mode and the visual mode alone. The lower performance of the hearing-impaired group suggested that rehabilitation processes should include training in the area of nonverbal perception. The rank order of the identification of emotions in both research samples was similar. Fear and surprise were the most difficult to identify. Similar order was found for each of the presentation modes as well. Further examination of the stimulus material with different groups of hearing-impaired individuals was recommended.