PPT-Deep Learning An overview using MLPs

Outline What is Deep Learning Tensors Data Structures for Deep Learning Multilayer Perceptron Activation Functions for Deep Learning Model Training in Deep Learning Regularization for Deep Learning. Quoc V. Le. Stanford University and Google. Purely supervised. Quoc V. . Le. Almost abandoned between 2000-2006. - . Overfitting. , slow, many local minima, gradient vanishing. In 2006, Hinton, et. al. proposed RBMs to . Rajdeep. . Dasgupta. CIDER Community Workshop, CA. May 08, 2016. Volcanic degassing. hazards. long-term climate. Bio-essential elements. Origin of life. Mantle melting. Chemical differentiation. Properties of asthenosphere. CS 501:CS Seminar. Min Xian. Assistant Professor. Department of Computer Science. University of Idaho. Image from NVIDIA. Researchers:. Geoff Hinton. Yann . LeCun. Andrew Ng. Yoshua. . Bengio. …. Aaron Schumacher. Data Science DC. 2017-11-14. Aaron Schumacher. planspace.org has these slides. Plan. applications. : . what. t. heory. applications. : . how. onward. a. pplications: what. Backgammon. Aaron Crandall, 2015. What is Deep Learning?. Architectures with more mathematical . transformations from source to target. Sparse representations. Stacking based learning . approaches. Mor. e focus on handling unlabeled data. New-Generation Models & Methodology for Advancing . AI & SIP. Li Deng . Microsoft Research, Redmond, . USA. Tianjin University, July 2-5, 2013. (including joint work with colleagues at MSR, U of Toronto, etc.) . Secada combs | bus-550. AI Superpowers: china, silicon valley, and the new world order. Kai Fu Lee. Author of AI Superpowers. Currently Chairman and CEO of . Sinovation. Ventures and President of . Sinovation. Algorithms and Application s Xuyu Wang, Auburn University Abstract: With the rapid growth of mass data , how to intelligently proc ess these big data and extract valuable information from hug John-William . Sidhom. , MD/PhD Candidate ’21. Department of Biomedical Engineering. Johns Hopkins University School of Medicine. Sidney Kimmel Comprehensive Cancer Center. Johns Hopkins University. New-Generation Models & Methodology for Advancing . Speech Technology . and Information Processing. Li Deng . Microsoft Research, Redmond, . USA. CCF, . Beijing. , July . 8. , 2013. (including joint work with colleagues at MSR, U of Toronto, etc.) . Assistant Professor. Computer Science and Engineering Department. Indian Institute of Technology Kharagpur. http://cse.iitkgp.ac.in/~adas/. Biological Neural Network. Image courtesy: F. . A. . Makinde. Usman Roshan. NJIT. Derivative free optimization. Pros:. Can handle any activation function (for example sign). Free from vanishing and exploding gradient problems. Cons:. May take longer than gradient search. Eli Gutin. MIT 15.S60. (adapted from 2016 course by Iain Dunning). Goals today. Go over basics of neural nets. Introduce . TensorFlow. Introduce . Deep Learning. Look at key applications. Practice coding in Python. Patient Cohort Retrieval . Sanda. . Harabagiu. , . PhD. , Travis Goodwin, Ramon Maldonado, Stuart Taylor . The . Human Language Technology Research Institute. University of Texas at Dallas. Human Language Technology.