Towards a full emotional system

Khadoudja Ghamen (1) , Alice Caplier (2)

1 UMC - Université Frères Mentouri – Constantine 1 = Constantine 1 – Frères Mentouri University
2 GIPSA-AGPIG - GIPSA - Architecture, Géométrie, Perception, Images, Gestes

The present paper proposes a system both able to classify a facial expression in one of the six categories namely: (Joy, Disgust, Anger, Sadness, Fear and Surprise) and to assign to each expression its intensity in the range: (High, Medium and Low). This is carried out in two independent and parallel processes. Permanent and transient facial features are detected from still images and pertinent information, about the presence of transient features on specific facial regions and about facial distances computed from permanent facial features, is extracted. Both classification and quantification processes are based on transient and permanent features. The belief theory is used with the two processes because of its ability in fusing data coming from different sensors. The system outputs a recognized and quantified expression. The quantification process allows recognizing a new subset of expressions deduced from the basic ones. Indeed, by associating to each expression three intensities low, medium and high, we deduce three facial expressions. Finally a set of eighteen facial expressions is categorized instead of the six ones. Experimental results are given to show the system classification accuracy of the system.

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Khadoudja Ghamen, Alice Caplier. Towards a full emotional system. Behaviour and Information Technology, 2012, 32 (8), pp.783-799. ⟨10.1080/0144929X.2011.624639⟩. ⟨hal-00741441⟩