Real Sound Synthesis for Interactive

Real Sound Synthesis for Interactive Applications emphasizes physical modeling of sound and focuses on real-world interactive sound effects. It is intended for game developers, graphics programmers, developers of virtual reality systems and training simulators, and others who want to learn about computational sound. It is written at an introductory level with mathematical foundations provided in appendices. An enclosed CD contains code examples and sound files from the book.

Introduction

xi

Digital Audio Signals

1

(10)

Introduction

1

(1)

Digital Audio Signals

1

(1)

Sampling and Aliasing

2

(2)

Quantization

4

(1)

Resampling and Interpolation

5

(2)

Digital Audio Compression

7

(2)

Conclusion

9

(2)

Sampling (Wavetable) Synthesis

11

(10)

Introduction

11

(1)

Wavetable Synthesis

11

(2)

Concatenative Speech Synthesis

13

(1)

Manipulating PCM

14

(4)

Let's Pause and Think Here

18

(3)

Digital Filters

21

(18)

Introduction

21

(1)

Linear Systems, LTI Systems, Convolution

21

(3)

Digital Filters

24

(1)

FIR Filters

24

(2)

IIR Filters

26

(1)

The General Filter Form

26

(1)

The Z Transform

27

(1)

The Transfer Function

28

(1)

Zeroes and Poles

29

(1)

First Order One-Zero and One-Pole Filters

29

(2)

The Second Order Pole/Zero (BiQuad) Filter

31

(3)

A Little on Filter Topologies

34

(2)

Conclusion

36

(3)

Modal Synthesis

39

(12)

Introduction

39

(1)

A Simple Mechanical System

39

(2)

Solution of the Mass/Spring/Damper System

41

(2)

Boundary Conditions and Solutions

43

(2)

Sinusoidal Additive Synthesis

45

(1)

Filter-Based Modal Synthesis

46

(2)

Residual Extraction and Resynthesis

48

(2)

Conclusion

50

(1)

The Fourier Transform

51

(12)

Introduction

51

(1)

The Frequency Domain Spectrum

52

(1)

The Fourier Series

52

(1)

The Discrete Fourier Transform

53

(2)

Orthogonality and Uniqueness of the DFT

55

(1)

Convolution with the DFT and the FFT

55

(2)

Some Fourier Transform Applications

57

(3)

The Short-Time Fourier Transform

60

(1)

Conclusions

61

(2)

Spectral Modeling and Additive Synthesis

63

(12)

Introduction

63

(1)

Types of Spectra

63

(5)

Spectral Modeling

68

(3)

Sines Plus Noise Plus Transients

71

(1)

Spectra in Time

72

(2)

Conclusion

74

(1)

Subband Vocoders and Filterbanks

75

(10)

Introduction

75

(1)

Subband Decomposition of Audio

75

(3)

The Channel Vocoder

78

(2)

The Cross-Synthesizing Channel Vocoder

80

(1)

The Phase Vocoder

81

(1)

Conclusions

82

(3)

Subtractive Synthesis sad LPC

85

(12)

Introduction

85

(1)

Subtractive Synthesis

85

(2)

Resonance-Factored (Formant) Synthesis

87

(1)

Linear Prediction

88

(2)

LPC Speech Examples

90

(2)

LPC for Nonspeech and Real-World Sounds

92

(2)

LPC and Physics

94

(1)

Conclusions

94

(3)

Strings and Bars

97

(12)

Introduction

97

(1)

The Ideal String

97

(4)

Refining the Ideal String

101

(2)

Weak Stiffness

103

(2)

Really Stiff Structures: Bars

105

(1)

Conclusions

106

(3)

Nonlinearity, Waveshaping, FM

109

(12)

Introduction

109

(1)

Simple Physical Nonlinearity

109

(4)

Simulating Physical Nonlinearity

113

(1)

Nonlinear Wave Synthesis by Lookup Table

114

(5)

Conclusions

119

(2)

Tubes and Air Cavities

121

(10)

Introduction

121

(1)

The Ideal Acoustic Tube

121

(1)

Building a Simple Clarinet

122

(2)

Resonance in Air Cavities

124

(4)

Conclusions

128

(3)

Two and Three Dimensions

131

(18)

Introduction

131

(1)

Membranes and Plates, Mass/Spring Models

131

(5)

Three-Dimensional Structures

136

(4)

Banded Waveguides in Higher Dimensions

140

(3)

Spatial Modes in Complex Geometries

143

(3)

Conclusions

146

(3)

FOFs, Wavelets, and Particles

149

(20)

Introduction

149

(1)

Formants in the Time Domain: FOFs

149

(3)

Wavelets

152

(3)

Granular Synthesis

155

(1)

Particle Models

155

(12)

Conclusions

167

(2)

Exciting and Controlling Sound Models

169

(22)

Introduction

169

(1)

Plucking and Striking

169

(5)

Friction

174

(9)

Controlling Synthesis Parameters

183

(4)

Controllers

187

(2)

Conclusions

189

(2)

Walking Synthesis: A Complete System

191

(10)

Introduction

191

(1)

Overall Architecture of the System

191

(1)

Event Analysis

192

(2)

Spectral Analysis

194

(1)

Statistical Modeling and Estimation

194

(3)

Testing on Real Sounds

197

(2)

Parametric Resynthesis

199

(1)

Conclusion

199

(2)

Examples, Systems, and Applications

201

(10)

Introduction

201

(1)

Auditory Display: Real-Time Multimodal User Interfaces

201

(1)

Auditory Display: Sonification

202

(3)

Digital Foley Production Workstation/Stage

205

(1)

Virtual and Augmented Reality

206

(1)

Computer Music and Interactive Art

206

(1)

Animation and Gaming

207

(2)

The Future

209

(2)

A. DFT, Convolution, and Transform Properties

211

(10)

Orthogonality of the Fourier Transform Kernel

211

(1)

Uniqueness of the Fourier Transform

212

(1)

Convolution

213

(1)

Convolution and the DFT

214

(2)

A Few Useful DFT Properties and Theorems

216

(5)

B. The Ideal String

221

(4)

The Ideal String

221

(4)

C. Acoustic Tubes

225

(8)

The Ideal Acoustic Tube

225

(2)

D'Alembert Solution to the Acoustic Tube Equation

227

(1)

Relating Pressure and Velocity in Acoustic Tubes

227

(1)

The Acoustic Tube With Varying Cross-Sectional Area

228

(2)

An Acoustic Tube Network

230

(3)

D. Sound Examples and Code on CD/CDROM

233

(6)

Sound Examples

233

(3)

Source Code and Other Materials on CDROM Data Segment

236

(3)

E. The Synthesis Toolkit in C++

239

(10)

What is the Synthesis Toolkit?

239

(2)

A Brief History of the Development of The Synthesis ToolKit

241

(1)

Synthesizing Sound in Real Time

241

(2)

Non-Real-Time Soundfile Synthesis

243

(1)

An Example Instrument: Blown Bottle

244

(1)

Real-Time Synthesis Control

245

(1)

Classes and Instruments

246

(2)

Conclusions

248

(1)

Index

249

What is included with this book?

The New copy of this book will include any supplemental materials advertised. Please check the title of the book to determine if it should include any access cards, study guides, lab manuals, CDs, etc.

The Used, Rental and eBook copies of this book are not guaranteed to include any supplemental materials. Typically, only the book itself is included. This is true even if the title states it includes any access cards, study guides, lab manuals, CDs, etc.

FREE SHIPPING

Amazon no longer offers textbook rentals. We do!

Real Sound Synthesis for Interactive Applications

Summary

Table of Contents

Supplemental Materials