[SIGGRAPH 2018] Toward Wave-based Sound Synthesis for Computer Animation

Watch on YouTube

Show annotations

Download is disabled.

69,714

2,434

20

Genre: Science & Technology

Family friendly? Yes

Wilson score: 0.98740000000000006

Rating: 4.9674 / 5

Engagement: 3.52%

Wang Jui-Hsien

Subscribe | 319

Shared May 11, 2018

NEW 08/02/2018: We have a highlight version of the video. See here: https://www.youtube.com/watch?v=5I8KC...

http://graphics.stanford.edu/projects...

Jui-Hsien Wang, Ante Qu, Timothy R. Langlois, and Doug L. James. 2018. Toward Wave-based Sound Synthesis for Computer Animation. ACM Trans. Graph. 37, 4, Article 109 (August 2018), 16 pages. https://doi.org/10.1145/3197517.3201318

Abstract:
We explore an integrated approach to sound generation that supports a wide variety of physics-based simulation models and computer-animated phenomena. Targeting high-quality offline sound synthesis, we seek to resolve animation-driven sound radiation with near-field scattering and diffraction effects. The core of our approach is a sharp-interface finite-difference time-domain (FDTD) wavesolver, with a series of supporting algorithms to handle rapidly deforming and vibrating embedded interfaces arising in physics-based animation sound. Once the solver rasterizes these interfaces, it must evaluate acceleration boundary conditions (BCs) that involve mode- and phenomena-specific computations. We introduce acoustic shaders as a mechanism to abstract away these complexities, and describe a variety of implementations for computer animation: near-rigid objects with ringing and acceleration noise, deformable (finite element) models such as thin shells, bubble-based water, and virtual characters. Since time-domain wave synthesis is expensive,we only simulate pressure waves in a small region about each sound source, then estimate a far-field pressure signal. To further improve scalability beyond multi-threading, we propose a fully time-parallel sound synthesis method that is demonstrated on commodity cloud computing resources. In addition to presenting results for multiple animation phenomena (water, rigid, shells, kinematic deformers, etc.) we also propose 3D automatic dialogue replacement (3DADR) for virtual characters so that pre-recorded dialogue can include character movement, and near-field shadowing and
scattering sound effects.



2:37:42

SIGGRAPH 2016 Course: Physically Based Sound for Computer Animation and Virtual Environments

13K views

3:51

Seeing sound with light: strobes and resonance

271K views

5:43

[SIGGRAPH 2019] Local Light Field Fusion (technical video)

18K views

6:14

[SIGGRAPH 2017] A Multi-Scale Model for Simulating Liquid-Hair Interactions

188K views

7:02

SIGGRAPH 2018: DeepMimic paper (main video)

131K views

1:00:32

Precision! - Evidence for Ancient High Technology, part 2

158K views

3:39

Folding and Crumpling Adaptive Sheets, SIGGRAPH 2013

94K views

4:56

Computational Hydrographic Printing (SIGGRAPH 2015)

1M view

5:00

[SIGGRAPH 2018] Animating Fluid Sediment Mixture in Particle-Laden Flows

21K views

45:54

Siggraph 2018 Rewind - Matthäus Niedoba: Behind the Voxels: Bringing Volumes to Cinema 4D

47K views

5:01

(SIGGRAPH 2019) CD-MPM: Continuum Damage Material Point Methods for Dynamic Fracture Animation

47K views

6:25

Interlinked SPH Pressure Solvers for Strong Fluid-Rigid Coupling

32K views

3:23

[SIGGRAPH 2018] Neural Best-Buddies: Sparse Cross-Domain Correspondence

9.1K views

4:24

Viscous SPH - ACM SIGGRAPH 2015

293K views

4:26

Stable Neo-Hookean Flesh Simulation (SIGGRAPH 2018)

36K views

5:15

tempoGAN: A Temporally Coherent, Volumetric GAN for Super-resolution Fluid Flow (SIGGRAPH)

6.8K views

4:01

Adaptive Tearing and Cracking of Thin Sheets, SIGGRAPH 2014

1.2M views

5:02

Crumpling Sound Synthesis (SIGGRAPH Asia 2016)

126K views

5:56

SIGGRAPH 2018: Space-time Tomography for Continuously Deforming Objects

42K views