/
Dougal Sutherland, 9/25/13 Dougal Sutherland, 9/25/13

Dougal Sutherland, 9/25/13 - PowerPoint Presentation

danika-pritchard
danika-pritchard . @danika-pritchard
Follow
390 views
Uploaded On 2016-08-07

Dougal Sutherland, 9/25/13 - PPT Presentation

Problem with regular RNNs The standard learning algorithms for RNNs dont allow for long time lags Problem error signals going back in time in BPTT RTRL etc either exponentially blow up or usually exponentially vanish ID: 437145

error experiment lstm memory experiment error memory lstm works exponential noise output cells input decay learning sequence add time

Share:

Link:

Embed:

Download Presentation from below link

Download Presentation The PPT/PDF document "Dougal Sutherland, 9/25/13" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.


Presentation Transcript