Sound effect on visual gaze when looking at videos - AGPIG Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

Sound effect on visual gaze when looking at videos

Résumé

This paper presents an analysis of sound effect on visual gaze when looking at videos to help to predict eye positions. First, an audio-visual experiment was designed with two groups of participants, with audio-visual (AV) and visual (V) conditions to test the sound effect. We classify the sound in three classes: on-screen speech, non-speech and non-sound. We observe with statistical methods that the sound effect is different depending on the class of sound. Then a comparison of the experimental data and a visual saliency model was carried out, which proves that adding sound to video decreases the accuracy of the prediction of the visual saliency model without a sound pathway. Finally, the result of locating the coordinates of a sound source manually provides a viable aspect of sound pathway for future work.
Fichier principal
Vignette du fichier
SOUND_EFFECT_ON_VISUAL_GAZE_WHEN_LOOKING_AT_VIDEOS.pdf (159.09 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00629263 , version 1 (05-10-2011)

Identifiants

  • HAL Id : hal-00629263 , version 1

Citer

Guanghan Song, Denis Pellerin, Lionel Granjon. Sound effect on visual gaze when looking at videos. EUSIPCO 2011 - 19th European Signal Processing Conference, Aug 2011, Barcelone, Spain. pp.2034-2038. ⟨hal-00629263⟩
448 Consultations
97 Téléchargements

Partager

Gmail Facebook X LinkedIn More