Non-linear Contact Sound Synthesis for Real-Time Audiovisual Applications using Modal Textures
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Sound design is an integral part of making a virtual environment come to life. Spatialization is important to the
perceptual localization of sounds, while the quality determines how well virtual objects come to life. The implementation of pre-recorded audio for physical interactions
in virtual environments often requires a vast library of audio files to distinguish each interaction from the other.
This paper explains the implementation of a modal synthesis toolkit for the Unity game engine to automatically
add impact and rolling sounds to interacting objects. Position-dependent sounds are achieved using a custom shader
that can contain textures with modal weighting parameters.
The two types of contact sounds are synthesized using a
mechanical oscillator describing a mass-spring system. We
describe the discretization methods adopted, the solution
of the nonlinear interaction and an implementation in the
Unity game engine.
perceptual localization of sounds, while the quality determines how well virtual objects come to life. The implementation of pre-recorded audio for physical interactions
in virtual environments often requires a vast library of audio files to distinguish each interaction from the other.
This paper explains the implementation of a modal synthesis toolkit for the Unity game engine to automatically
add impact and rolling sounds to interacting objects. Position-dependent sounds are achieved using a custom shader
that can contain textures with modal weighting parameters.
The two types of contact sounds are synthesized using a
mechanical oscillator describing a mass-spring system. We
describe the discretization methods adopted, the solution
of the nonlinear interaction and an implementation in the
Unity game engine.
Original language | English |
---|---|
Title of host publication | 16th Sound and Music Computing Conference (SMC2019), Málaga, Spain, 28-31 May |
Publisher | Sound and Music Computing Network |
Publication date | 2019 |
Pages | 431-436 |
ISBN (Electronic) | 978-84-09-08518-7 |
DOIs | |
Publication status | Published - 2019 |
Externally published | Yes |
Event | Event16th Sound and music computing conference - Malaga, Spain Duration: 28 May 2019 → 31 May 2019 |
Conference
Conference | Event16th Sound and music computing conference |
---|---|
Land | Spain |
By | Malaga |
Periode | 28/05/2019 → 31/05/2019 |
ID: 258846984