sound rendering

Interactive Sound Propagation using Compact Acoustic Transfer Operators
Lakulish Antani, Anish Chandak, Lauri Savioja, Dinesh Manocha
ACM Transactions on Graphics (Volume 31, Issue 1, January 2012)

We present an interactive sound propagation algorithm that can compute high orders of specular and diffuse reflections as well as edge diffractions in response to moving sound sources and a moving listener. Our formulation is based on a precomputed acoustic transfer operator, which we compactly represent using the Karhunen-Loeve transform. At runtime, we use a twopass approach that combines acoustic radiance transfer with interactive ray tracing to compute early reflections as well as higher-order reflections and late reverberation. The overall approach allows accuracy to be traded off for improved performance at run-time, and has a low memory overhead. We demonstrate the performance of our algorithm on different scenarios, including an integration of our algorithm with Valve’s Source game engine.

Paper Video Website

Direct-to-Indirect Acoustic Radiance Transfer
Lakulish Antani, Anish Chandak, Micah Taylor, Dinesh Manocha
IEEE Transactions on Visualization and Computer Graphics (Volume 18, Issue 2, February 2012)

We present an efficient algorithm for simulating diffuse reflections of sound in a static scene. Our approach is built on recent advances in precomputed light transport techniques for visual rendering and uses them to develop an improved acoustic radiance transfer technique. We precompute a direct-to-indirect acoustic transfer operator for a scene, and use it to map direct sound incident on the surfaces of the scene to multibounce diffuse indirect sound, which is gathered at the listener to compute the final impulse response. Our algorithm decouples the transfer operator from the source position so we can efficiently update the acoustic response at the listener when the source moves. We highlight its performance on various benchmarks and observe significant speedups over prior methods based on acoustic radiance transfer.

Paper Video Website

RESound: Interactive Sound Rendering for Dynamic Virtual Environments
Micah Taylor, Anish Chandak, Lakulish Antani, Dinesh Manocha
ACM Multimedia 2009

Interactive Geometric Sound Propagation and Rendering
Micah Taylor, Anish Chandak, Lakulish Antani, Dinesh Manocha
Intel Visual Adrenaline, June 2010

We present an interactive algorithm and system (RESound) for sound propagation and rendering in virtual environments and media applications. RESound uses geometric propagation techniques for fast computation of propagation paths from a source to a listener and takes into account specular reflections, diffuse reflections, and edge diffraction. In order to perform fast path computation, we use a unified ray-based representation to efficiently trace discrete rays as well as volumetric ray-frusta. RESound further improves sound quality by using statistical reverberation estimation techniques. We also present an interactive audio rendering algorithm to generate spatialized audio signals. The overall approach can handle dynamic scenes with no restrictions on source, listener, or obstacle motion. Moreover, our algorithm is relatively easy to parallelize on multi-core systems. We demonstrate its performance on complex game-like and architectural environments.

Paper Video 1 Video 2 Video 3 Website Article