/
Do Deep Networks have  Bad Local Minima? Do Deep Networks have  Bad Local Minima?

Do Deep Networks have Bad Local Minima? - PowerPoint Presentation

pamella-moone
pamella-moone . @pamella-moone
Follow
345 views
Uploaded On 2018-12-16

Do Deep Networks have Bad Local Minima? - PPT Presentation

Brief survey on optimization landscape for neural networks Rong Ge Duke University Nonconvex optimization Theory NPhard Practice simple algorithmsSGD Difficulties Saddle Points Highorder Saddles ID: 742162

network objective networks local objective network local networks min linear bad minima global order input gradient neural distribution neurons

Share:

Link:

Embed:

Download Presentation from below link

Download Presentation The PPT/PDF document "Do Deep Networks have Bad Local Minima?" is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.


Presentation Transcript