TY - GEN
T1 - Rethinking recurrent latent variable model for music composition
AU - Kohl, Eunjeong Stella
AU - Dubnov, Shlomo
AU - Wright, Dustin
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/11/26
Y1 - 2018/11/26
N2 - We present a model for capturing musical features and creating novel sequences of music, called the Convolutional-Variational Recurrent Neural Network. To generate sequential data, the model uses an encoder-decoder architecture with latent probabilistic connections to capture the hidden structure of music. Using the sequence-to-sequence model, our generative model can exploit samples from a prior distribution and generate a longer sequence of music. We compare the performance of our proposed model with other types of Neural Networks using the criteria of Information Rate that is implemented by Variable Markov Oracle, a method that allows statistical characterization of musical information dynamics and detection of motifs in a song. Our results suggest that the proposed model has a better statistical resemblance to the musical structure of the training data, which improves the creation of new sequences of music in the style of the originals.
AB - We present a model for capturing musical features and creating novel sequences of music, called the Convolutional-Variational Recurrent Neural Network. To generate sequential data, the model uses an encoder-decoder architecture with latent probabilistic connections to capture the hidden structure of music. Using the sequence-to-sequence model, our generative model can exploit samples from a prior distribution and generate a longer sequence of music. We compare the performance of our proposed model with other types of Neural Networks using the criteria of Information Rate that is implemented by Variable Markov Oracle, a method that allows statistical characterization of musical information dynamics and detection of motifs in a song. Our results suggest that the proposed model has a better statistical resemblance to the musical structure of the training data, which improves the creation of new sequences of music in the style of the originals.
UR - http://www.scopus.com/inward/record.url?scp=85059973692&partnerID=8YFLogxK
U2 - 10.1109/MMSP.2018.8547061
DO - 10.1109/MMSP.2018.8547061
M3 - Conference contribution
AN - SCOPUS:85059973692
T3 - 2018 IEEE 20th International Workshop on Multimedia Signal Processing, MMSP 2018
BT - 2018 IEEE 20th International Workshop on Multimedia Signal Processing, MMSP 2018
PB - Institute of Electrical and Electronics Engineers
T2 - 20th IEEE International Workshop on Multimedia Signal Processing, MMSP 2018
Y2 - 29 August 2018 through 31 August 2018
ER -