The Vibe: a versatile vision-to-audition sensory substitution device - AGPIG Accéder directement au contenu
Article Dans Une Revue Applied Bionics and Biomechanics Année : 2010

The Vibe: a versatile vision-to-audition sensory substitution device

Résumé

We describe a sensory substitution scheme that converts a video stream into an audio stream in real-time. It was initially developed as a research tool for studying human ability to learn new ways of perceiving the world: the Vibe can give us the ability to learn a kind of 'vision' by audition. It converts a video stream into a continuous stereophonic audio signal that conveys information coded from the video stream. The conversion from the video stream to the audio stream uses a kind of retina with receptive fields. Each receptive field controls a sound source and the user listens to a sound that is a mixture of all these sound sources. Compared to other existing vision-to-audition sensory substitution devices, the Vibe is highly versatile in particular because it uses a set of configurable units working in parallel. In order to demonstrate the validity and interest of this method of vision to audition conversion, we give the results of an experiment involving a pointing task to targets memorised through visual perception or through their auditory conversion by the Vibe. This article is also an opportunity to precisely draw the general specifications of this scheme in order to prepare its implementation on an autonomous/mobile hardware.

Dates et versions

hal-00577751 , version 1 (17-03-2011)

Identifiants

Citer

Sylvain Hanneton, Malika Auvray, Barthélémy Durette. The Vibe: a versatile vision-to-audition sensory substitution device. Applied Bionics and Biomechanics, 2010, 7 (4), pp.269-276. ⟨10.1080/11762322.2010.512734⟩. ⟨hal-00577751⟩
283 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More