News for hackers. Stuff that matters.
Re:Reservoir computing by jphoward on Friday October 19, 2018 @08:46AM (#18256301)
What I don't understand is if you can train a final layer on the reservoir's random representation, why is this better than just training the final layer on your data directly? I assume the answer has something to do with dimensionality reduction?
Re:Reservoir computing by breuderink on Friday October 19, 2018 @03:06PM (#18259132)
The reservoir can compute non-linear functions of the input over time. So, with a reservoir, you can train a linear projection of the reservoir state that responds non-linearly to the input. Without the reservoir, the output projection can only be linearly related to the input.
Re:Reservoir computing by falcolas on Friday October 19, 2018 @09:42AM (#18256630)
If I were to guess, I would say that the reservoir would amplify differences in data that may not be easily separated in the source data.

Sort of acting like a hash function - small differences in the source become large differences in the output.