Non-linear Contact Sound Synthesis for Real-Time Audiovisual Applications using Modal Textures

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Sound design is an integral part of making a virtual environment come to life. Spatialization is important to the
perceptual localization of sounds, while the quality determines how well virtual objects come to life. The implementation of pre-recorded audio for physical interactions
in virtual environments often requires a vast library of audio files to distinguish each interaction from the other.
This paper explains the implementation of a modal synthesis toolkit for the Unity game engine to automatically
add impact and rolling sounds to interacting objects. Position-dependent sounds are achieved using a custom shader
that can contain textures with modal weighting parameters.
The two types of contact sounds are synthesized using a
mechanical oscillator describing a mass-spring system. We
describe the discretization methods adopted, the solution
of the nonlinear interaction and an implementation in the
Unity game engine.
Original languageEnglish
Title of host publication16th Sound and Music Computing Conference (SMC2019), Málaga, Spain, 28-31 May
PublisherSound and Music Computing Network
Publication date2019
Pages431-436
ISBN (Electronic)978-84-09-08518-7
DOIs
Publication statusPublished - 2019
Externally publishedYes
EventEvent16th Sound and music computing conference - Malaga, Spain
Duration: 28 May 201931 May 2019

Conference

ConferenceEvent16th Sound and music computing conference
LandSpain
ByMalaga
Periode28/05/201931/05/2019

ID: 258846984