Event:
21.01.2019, 18:00 | Bernstein Center for Computational Neuroscience | ||
|
Event Type:
Talk
Speaker: Herbert Jaeger Institute: Jacobs University Bremen Title: An introduction to Reservoir Computing |
Location:
LMU Biocenter, Room B01.019 Großhaderner Str. 2 82152 Martinsried Host: Andreas Herz Host Email: herz@bccn-munich.de |
|
Abstract:
Recurrent neural networks (RNNs) are general approximators for nonlinear dynamical systems and have recently become widely used in the "deep learning" field of machine learning, especially for speech and language processing tasks. However, such deep learning set-ups are computationally very expensive, require very large volumes of training data, and need high-precision numerical processing.
Reservoir Computing (RC) is an alternative machine learning approach for RNNs which is in many aspects complementary to the ways of deep learning. In RC, a large, random, possibly low-precision and noisy RNN is used as a nonlinear excitable medium - called the "reservoir" - which is driven by an input signal. The reservoir itself is not adapted or trained. Instead, only a "readout" mechanism is trained, which assembles the desired output signal from the large variety of random, excited signals within the reservoir. This simple principle is surprisingly powerful - and it represents one of the few real bridging concepts between computational neuroscience and machine learning. Recently RC has become popular in research that aims at useful computations on the basis on unconventional hardware - hardware that is non-digital, stochastic, low-precision, and time-varying just like biological brains. Registration Link: |