Article | REF: BR1150 V1

Spatial audio - Perception, recording, and synthesis of sound scenes

Author: Thibaut CARPENTIER

Publication date: November 10, 2022

You do not have access to this resource.
Click here to request your free trial access!

Already subscribed? Log in!


Overview

Français

ABSTRACT

Spatial audio refers to the analysis, synthesis, and transformation of the properties of sound that contribute to immersion and spatial impression. In virtual environments - video games, virtual reality -, it makes it possible to simulate sound sources in the space around the listener. In the field of audio-visual production, it aims to capture or create sound scenes. This article exposes the main psychoacoustic mechanisms of spatial hearing, then it presents the state of the art of the techniques allowing the synthesis - by loudspeaker arrays - and the recording - by microphone arrays - of sound fields.

Read this article from a comprehensive knowledge base, updated and supplemented with articles reviewed by scientific committees.

Read the article

AUTHOR

  • Thibaut CARPENTIER: CNRS Research Engineer - STMS Lab (sciences and technologies of music and sound) – CNRS, IRCAM, Sorbonne University Paris, France

 INTRODUCTION

In acoustics and music, sounds are generally characterized by their properties of duration, pitch, timbre and intensity. In addition to these attributes, sounds are also organized in space. Spatialization is the study of sound in its spatial dimension. More precisely, sound spatialization is concerned with the analysis, synthesis and transformation of the properties of sound that contribute to the impression of space and the sensation of immersion. This field of study draws on fundamental research and technological advances from several scientific disciplines: acoustics, signal processing, computer science, psychoacoustics and cognition. Sound spatialization, sometimes referred to as "3D audio", "spatial audio", "multichannel sound", or "virtual acoustics", is a fast-growing field of research with industrial and consumer applications in a wide range of sectors: audiovisual production (music, cinema, radio, 360° video), live performance (sound reinforcement), video games, virtual reality, sound installations, acoustic simulations, etc. For example, in music mixing, spatialization is used to spatially distribute the various instruments to enhance their intelligibility and the clarity of the soundstage. In virtual environments (video games, virtual reality), it simulates sound sources in the space around the listener, contributing to the sensation of immersion.

Depending on the field of application and use case, the aim of sound spatialization is sometimes to capture and restore existing sound scenes or acoustic spaces, and sometimes to virtually create auditory experiences with an immersive sound dimension. To achieve this, the processes implemented exploit networks of electroacoustic transducers (loudspeakers, headphones, microphones) and audio signal processing algorithms, and aim to produce either a realistic rendering ("objectively precise") or a more artistic illusion ("perceptually plausible").

Spatial sound diffusion systems seek, on the one hand, to simulate spatial localization cues for virtual sound sources arbitrarily placed in space and, on the other, to produce artificial reverberation effects that contribute to the creation of an immersive sound space. The techniques available can be classified into three main families: so-called "perceptive" approaches, which rely on models of human hearing to create the illusion of an acoustic phenomenon (positioning a "phantom" source in 3D space, or a reverberation effect that appears "natural"); sampling approaches, which involve measuring an acoustic field at a discrete set of positions and then restoring it using convolution techniques; and physical model approaches, which aim to synthesize, in a certain area of space, a precisely controlled acoustic field that conforms to the laws of wave propagation. Each of...

You do not have access to this resource.

Exclusive to subscribers. 97% yet to be discovered!

You do not have access to this resource.
Click here to request your free trial access!

Already subscribed? Log in!


The Ultimate Scientific and Technical Reference

A Comprehensive Knowledge Base, with over 1,200 authors and 100 scientific advisors
+ More than 10,000 articles and 1,000 how-to sheets, over 800 new or updated articles every year
From design to prototyping, right through to industrialization, the reference for securing the development of your industrial projects

KEYWORDS

Binaural   |   Ambisonic   |   Wave-field synthesis   |   Spatial hearing   |   Multichannel audio


This article is included in

Signal processing and its applications

This offer includes:

Knowledge Base

Updated and enriched with articles validated by our scientific committees

Services

A set of exclusive tools to complement the resources

Practical Path

Operational and didactic, to guarantee the acquisition of transversal skills

Doc & Quiz

Interactive articles with quizzes, for constructive reading

Subscribe now!

Ongoing reading
Sound spatialization