PPT-Deep Learning: An Overview

Weifeng Li Victor Benjamin Xiao Liu and Hsinchun Chen University of Arizona 1 Acknowledgements Many of the pictures results and other materials are taken from Aarti Singh Carnegie Mellon University. Adam Coates. Stanford University. (Visiting Scholar: Indiana University, Bloomington). What do we want ML to do?. Given image, predict complex high-level patterns:. Object recognition. Detection. Segmentation. Quoc V. Le. Stanford University and Google. Purely supervised. Quoc V. . Le. Almost abandoned between 2000-2006. - . Overfitting. , slow, many local minima, gradient vanishing. In 2006, Hinton, et. al. proposed RBMs to . Information Processing & Artificial Intelligence. New-Generation Models & Methodology for Advancing . AI & SIP. Li Deng . Microsoft Research, Redmond, . USA. Tianjin University, July 4, 2013 (Day 3). Early Work. Why Deep Learning. Stacked Auto Encoders. Deep Belief Networks. CS 678 – Deep Learning. 1. Deep Learning Overview. Train networks with many layers (vs. shallow nets with just a couple of layers). Aaron Crandall, 2015. What is Deep Learning?. Architectures with more mathematical . transformations from source to target. Sparse representations. Stacking based learning . approaches. Mor. e focus on handling unlabeled data. Professor Qiang Yang. Outline. Introduction. Supervised Learning. Convolutional Neural Network. Sequence Modelling: RNN and its extensions. Unsupervised Learning. Autoencoder. Stacked . Denoising. . Continuous. Scoring in Practical Applications. Tuesday 6/28/2016. By Greg Makowski. Greg@Ligadata.com. www.Linkedin.com/in/GregMakowski. Community @. . http. ://. Kamanja.org. . . Try out. Future . The Future of Real-Time Rendering?. 1. Deep Learning is Changing the Way We Do Graphics. [Chaitanya17]. [Dahm17]. [Laine17]. [Holden17]. [Karras17]. [Nalbach17]. Video. “. Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion”. CS 501:CS Seminar. Min Xian. Assistant Professor. Department of Computer Science. University of Idaho. Image from NVIDIA. Researchers:. Geoff Hinton. Yann . LeCun. Andrew Ng. Yoshua. . Bengio. …. Aaron Crandall, 2015. What is Deep Learning?. Architectures with more mathematical . transformations from source to target. Sparse representations. Stacking based learning . approaches. Mor. e focus on handling unlabeled data. Secada combs | bus-550. AI Superpowers: china, silicon valley, and the new world order. Kai Fu Lee. Author of AI Superpowers. Currently Chairman and CEO of . Sinovation. Ventures and President of . Sinovation. Garima Lalwani Karan Ganju Unnat Jain. Today’s takeaways. Bonus RL recap. Functional Approximation. Deep Q Network. Double Deep Q Network. Dueling Networks. Recurrent DQN. Solving “Doom”. Outline. What is Deep Learning. Tensors: Data Structures for Deep Learning. Multilayer Perceptron. Activation Functions for Deep Learning. Model Training in Deep Learning. Regularization for Deep Learning. networks with many layers . (vs. shallow nets with just a couple of layers). Multiple layers work to build an improved feature space. First layer learns 1. st. order features (e.g. edges…). 2. nd.