Audio companion for 'Differentiable FM synthesis'
Master Thesis, May 2021
Author: Juan Alonso
Supervisor: Cumhur Erkut
Sound and Music Computing, Aalborg University
Code available at https://github.com/juanalonso/ddsp_fm.
⚠️ Please, lower the volume of your computer.
Mult processor
Original wave
Sine wave, 440Hz
Ring Modulation
LFO at 5Hz
LFO at 110Hz
Amplitude Modulation
LFO at 5Hz
LFO at 110Hz
AM synthesis
Single control point
Multiple control points
FM synthesis
Sounds generated with the interactive FM patch generator.
Algorithm 1. All the ops in series.
Algorithm 4. Not present in Reface DX.
Algorithm 5. Three modulators in parallel.
Algorithm 6. Simple FM x 2.
Algorithm 8. Not present in Reface DX.
Algorithm 9.
Algorithm 10.
Algorithm 13. One modulator to three carriers.
Algorithm 14. Odd harmonics.
Recreation of classic patches: E. PIANO 1
Dexed
Op5 and op6 disbled, flat envelopes.
DDSP-FM
Algorithm 6. Handpicked parameters.
Timbre transfer
AM
The differentiable AM synth reconstructs its own sounds.
Original
Timbre transfer
FM
The differentiable FM synth reconstructs AM sounds.
Original
Timbre transfer
FM
The differentiable FM synth reconstructs violin sounds.
Original
Timbre transfer
Operator 1
Operator 2
Operator 3
Parametric latent space
Autoencoder
Path through a populated area
Path through an unpopulated area
Variational Autoencoder σ=1.0
Path through a populated area
Variational Autoencoder σ=0.1
Path through a populated area
Path through an unpopulated area
Reconstructions
Most similar - Algorithm 14
Reference
AE
AE quantized
VAE
VAE quantized
Most different - Algorithm 11
Reference
AE
AE quantized
VAE
VAE quantized
Timbre matching
Reconstruction 1
Original
Reconstruction
Reconstruction 2
Original
Reconstruction
Reconstruction 3
Original
Reconstruction
