Interestingly, sparseness was not programmed into the network this property simply arose from learning the musical input. We found that increasing sparseness of the hidden layer activations strongly correlated with the increasing sophistication of the network's output. The second study used more complex musical input and focused on both tonal and rhythmic relationships in music. The developmental trajectory of the network was studied by examining sparseness of the hidden layer activations and the sophistication of the network's compositions. The first study focused on learning the tonal relationships inherent in five simple melodies. Both experiments compare the network's internal representations to behavioral data: Listeners rate the network's own novel musical output from different points along the learning trajectory. Two experiments are presented that examine the learning trajectory of a simple recurrent network exposed to musical input.
Our simple recurrent network has demonstrated the same to be true of learning musical structure. Evidence suggests that sparse coding allows for a more efficient and effective way to distill structural information about the environment.
0 kommentar(er)
