Towards Time-Aware Music Interpolation in Latent Space

Dmitrii Gavrilev

Skoltech

Code Repository

Audio Samples

Beethoven — Symphony No. 5

Source of audio samples.

Sample 1

Recording of the Vienna Philharmonic Orchestra conducted by Herbert von Karajan, 1946

Sample 2

MIDI piano performance

Symmetric

Frechet function value: 21.71

DBA (random init)

Frechet function value: 28.40 ± 0.33

DBA (default init)

Frechet function value: 30.68

Symmetric + DBA

Frechet function value: 19.82

Knockin' On Heaven's Door

Source of audio samples.

Sample 1

The original version by Bob Dylan

Sample 2

Cover by Avril Lavigne

Symmetric

Frechet function value: 26.75

DBA (random init)

Frechet function value: 28.97 ± 0.21

DBA (default init)

Frechet function value: 27.16

Symmetric + DBA

Frechet function value: 26.65

Schumann — Träumerei

Source of audio samples.

Sample 1

Piano (Gabriel Antonio Hernandez Romero)

Sample 2

Cello (Matilda Colliard), Piano (Stefano Ligoratti)

Symmetric

Frechet function value: 22.97

DBA (random init)

Frechet function value: 24.43 ± 0.09

DBA (default init)

Frechet function value: 25.41

Symmetric + DBA

Frechet function value: 22.45

Nirvana — Polly

Source of audio samples.

Sample 1

Electric guitar version

Sample 2

Unplugged version

Symmetric

Frechet function value: 24.99

DBA (random init)

Frechet function value: 26.62 ± 0.14

DBA (default init)

Frechet function value: 28.53

Symmetric + DBA

Frechet function value: 23.42

Acoustic guitar fingerpicking

Source of audio samples: Shared by the authors

Sample 1

Real performance

Sample 2

Performance synthesized in Guitar Pro

Symmetric

Frechet function value: 23.28

DBA (random init)

Frechet function value: 25.83 ± 0.19

DBA (default init)

Frechet function value: 29.25

Symmetric + DBA

Frechet function value: 22.70

Franz Liszt — "La campanella"

Source of audio samples: Synthesized by the authors

Sample 1

MIDI piano performances

Sample 2

MIDI piano performance

Symmetric

Frechet function value: 11.52

DBA (random init)

Frechet function value: 16.12 ± 0.41

DBA (default init)

Frechet function value: 15.36

Symmetric + DBA

Frechet function value: 11.29

Drums

Source of audio samples: Synthesized by the authors

Sample 1

Fast drums synthesized in Guitar Pro

Sample 2

Slow drums synthesized in Guitar Pro

Symmetric

Frechet function value: 12.10

DBA (random init)

Frechet function value: 18.35 ± 0.37

DBA (default init)

Frechet function value: 16.29

Symmetric + DBA

Frechet function value: 11.48

Chopin — Ballade No. 2 in F major, Op. 38

Source of audio samples: Synthesized by the authors

Sample 1

MIDI piano performance

Sample 2

Transposed MIDI piano performance

Symmetric

Frechet function value: 21.87

DBA (random init)

Frechet function value: 23.05 ± 0.16

DBA (default init)

Frechet function value: 21.87

Symmetric + DBA

Frechet function value: 21.87