Overview
ABSTRACT
Sound spatialization corresponds to the simulation of our hearing’s spatial location cues for virtual sources. The objective of this article is to analyze spatial sound reproduction over proposed devices and interfaces. First of all, these systems can be separated into two categories: perceptual approaches, which create the illusion called “ghost sources,” and the less accurate but more comprehensive binaural approaches. The reconstruction of the physical sound field is then studied. Finally, a comparison of the different devices, their conditions for use and their integration into virtual reality, is made.
Read this article from a comprehensive knowledge base, updated and supplemented with articles reviewed by scientific committees.
Read the articleAUTHORS
-
Nicolas TSINGOS: Research Fellow, INRIA (French National Institute for Research in Computer Science and Control), REVES team (rendering and virtual sound environments)
-
Olivier WARUSFEL: Researcher, IRCAM (Institut de recherche et coordination acoustique/musique)
INTRODUCTION
Certain software techniques and associated hardware devices enable spatialized sound reproduction for virtual environments. The spatialization of sound, i.e. the simulation of our hearing's spatial localization cues for virtual sound sources, is one of the most active research themes in acoustics today. Consumer applications are legion: video games, home cinema, music, whether at home or on nomadic devices. In virtual reality applications, the addition of spatialized sound also enhances the sensation of immersion [1]. These technologies are all based on intensive fundamental research into the spatial perception of sound in humans [2]. Reference works such as [3] [4] can also be consulted for further details.
Generally speaking, spatial sound reproduction systems are concerned with reproducing for the listener's ears the appropriate localization cues for a virtual sound source according to its desired position. These systems can be categorized into two families. The first series, which can be described as perceptive approaches, is based on the fact that a simple model of sound level difference or arrival time at the two ears is sufficient to create the illusion of positioning a "phantom" source between the physical positions of the loudspeakers. This principle is the basis of classical stereophonic reproduction in particular, but can be extended to more complex loudspeaker arrays. The second series of approaches aims to reconstruct the acoustic field in the vicinity of the listener with physical precision. In this category, we distinguish between binaural approaches, which reconstruct the sound field at two points (the listener's ears), and more global approaches, which reproduce the correct sound field in an entire zone of space. Each of these approaches has its advantages and disadvantages in terms of computational resources, device complexity and number of simultaneous listeners. For further information, please refer to [3] and [5]. We also present some examples of the integration of spatial sound restitution devices into immersive virtual reality systems. In particular, we draw up a comparison of the different approaches and their optimal conditions of use. Finally, we devote the last section to a brief overview of a few existing software libraries for implementing such techniques, some of which benefit from hardware acceleration.
Exclusive to subscribers. 97% yet to be discovered!
You do not have access to this resource.
Click here to request your free trial access!
Already subscribed? Log in!
The Ultimate Scientific and Technical Reference
This article is included in
Signal processing and its applications
This offer includes:
Knowledge Base
Updated and enriched with articles validated by our scientific committees
Services
A set of exclusive tools to complement the resources
Practical Path
Operational and didactic, to guarantee the acquisition of transversal skills
Doc & Quiz
Interactive articles with quizzes, for constructive reading
Spatial sound reproduction
Bibliography
Databases
-
HRTF measurements
AUDIS http://www.euracoustics.org/
CIPIC http://interface.cipic.ucdavis.edu/CIL_html/CIL_HRTF_database.htm
Software libraries
DirectSound (DirectX, Microsoft) http://www.microsoft.com/windows/directx
EAX http://www.soundblaster.com/eax/
FMOD http://www.fmod.org/
...Research projects
Ambisonics http://www.ambisonic.net/
LISTEN (European project IST-1999-20646) http://recherche.ircam.fr/equipes/salles/projets.html
Organizations
European Acoustics Association (EEA) http://www.euracoustics.org/
Interactive Audio Special Interst Group (IASIG) http://www.iasig.org/
Institute for Research and Coordination of Acoustics and Music (IRCAM)
Manufacturers
Creative (sound cards) http://fr.europe.creative.com/
MH Acoustics LLC http://www.mhacoustics.com/
Soundfield http://www.soundfield.com/
...
Exclusive to subscribers. 97% yet to be discovered!
You do not have access to this resource.
Click here to request your free trial access!
Already subscribed? Log in!
The Ultimate Scientific and Technical Reference