Max-Planck-Institut für Informatik
max planck institut
informatik
mpii logo Minerva of the Max Planck Society
 

MPI-INF or MPI-SWS or Local Campus Event Calendar

New for: D1, D2, D3, D4, D5
<< Previous Entry Next Entry >> New Event Entry Edit this Entry Login to DB (to update, delete)
What and Who
Title:An Introduction to Reservoir Computing, and Beyond
Speaker:Dr. Herbert Jäger
coming from:Jacobs University Bremen
Speakers Bio:
Event Type:AG3 Talk
Visibility:D1, D2, D3, D4, D5, RG1, SWS, MMCI
We use this to send out email in the morning.
Level:MPI Audience
Language:English
Date, Time and Location
Date:Tuesday, 30 January 2018
Time:11:00
Duration:60 Minutes
Location:Saarbrücken
Building:E1 5
Room:029
Abstract
Recurrent neural networks (RNNs) are general approximators for nonlinear

dynamical systems and have recently become widely used in the "deep
learning" field of machine learning, especially for speech and language
processing tasks. For instance, Google's speech recognition and language
translation services are based on RNNs.

However, the deep learning set-ups for RNN training are computationally
expensive, require very large volumes of training data, and need
high-precision numerical processing. For such reasons, deep-learning
variants of RNNs are problematic in fields where training data are
scarce, where fast and cheap algorithms are desired, or where noisy or
low-precision hardware is to be used. This is often the case in domains
of nonlinear signal processing, control, brain-machine interfacing, or
biomedical signal processing.

Reservoir Computing (RC) is an alternative machine learning approach for
RNNs which is in many aspects complementary to the ways of deep
learning. In RC, a large, random, possibly low-precision and noisy RNN
is used as a nonlinear excitable medium - called the "reservoir" - which
is driven by an input signal. The reservoir itself is not adapted or
trained. Instead, only a "readout" mechanism is trained, which assembles
the desired output signal from the large variety of random, excited
signals within the reservoir. This readout training is cheap - typically
just a linear regression. RC has become a popular approach in research
that aims at useful computations on the basis on unconventional hardware
(non-digital, noisy, low-precision).

The talk gives a quick introduction to the basic principles of RC, and
then proceeds to recent add-ons to that paradigm.

Contact
Name(s):Ruth Schneppen-Christmann
Video Broadcast
Video Broadcast:NoTo Location:
Tags, Category, Keywords and additional notes
Note:
Attachments, File(s):

Created:
Ruth Schneppen-Christmann/AG3/MPII/DE, 01/24/2018 03:44 PM
Last modified:
halma/MPII/DE, 11/06/2018 03:44 PM
  • Ruth Schneppen-Christmann, 01/30/2018 09:15 AM
  • Ruth Schneppen-Christmann, 01/24/2018 03:46 PM -- Created document.