PPT-Fast and Accurate Deep Neural Network (DNN)-based

Eyeheight and Eyewidth Estimation Method Daehwan Lho Advisor Prof Joungho Kim TeraByte Interconnection and Package Laboratory Department of Electrical Engineering KAIST Concept of the Proposed Fast and Accurate Deep . Naiyan. Wang. Outline. Non-NN Approaches. Deep Convex Net. Extreme Learning Machine. PCAnet. Deep Fisher Net (Already . presented before). Discussion. Deep convex net. Each module is a two- layer convex network.. Kong Da, Xueyu Lei & Paul McKay. Digit Recognition. Convolutional Neural Network. Inspired by the visual cortex. Our example: Handwritten digit recognition. Reference: . LeCun. et al. . Back propagation Applied to Handwritten Zip Code Recognition. Professor Qiang Yang. Outline. Introduction. Supervised Learning. Convolutional Neural Network. Sequence Modelling: RNN and its extensions. Unsupervised Learning. Autoencoder. Stacked . Denoising. . Shuochao Yao, Yiwen Xu, Daniel Calzada. Network Compression and Speedup. 1. Source: . http://isca2016.eecs.umich.edu/. wp. -content/uploads/2016/07/4A-1.pdf. Network Compression and Speedup. 2. Why smaller models?. Han et al. Deep Compression : Compressing Deep Neural Networks with Pruning, Training Quantization and Huffman Coding, . Han et al. Deep Compression . Deep Learning on Embedded System ?. Some Statistics….. Deep Neural Networks . Huan Sun. Dept. of Computer Science, UCSB. March 12. th. , 2012. Major Area Examination. Committee. Prof. . Xifeng. . Yan. Prof. . Linda . Petzold. Prof. . Ambuj. Singh. Deep . Learning. James K . Baker, Bhiksha Raj. , Rita Singh. Opportunities in Machine Learning. Great . advances are being made in machine learning. Artificial Intelligence. Machine. Learning. After decades of intermittent progress, some applications are beginning to demonstrate human-level performance!. Weifeng Li, . Victor Benjamin, Xiao . Liu, and . Hsinchun . Chen. University of Arizona. 1. Acknowledgements. Many of the pictures, results, and other materials are taken from:. Aarti. Singh, Carnegie Mellon University. Lingxiao Ma. . †. , Zhi Yang. . †. , Youshan Miao. ‡. , Jilong Xue. ‡. , Ming Wu. ‡. , Lidong Zhou. ‡. , . Yafei. Dai. . †. †. . Peking University. ‡ . Microsoft Research. USENIX ATC ’19, Renton, WA, USA. Zhanpeng Jin Allen C. Cheng. zhj6@pitt.edu. . acc33@pitt.edu. . ASPLOS 2010, The Wild and Crazy Session VIII. Artificial Neural Network. (Source: ". Anatomy and Physiology. Topics: 1. st. lecture wrap-up, difficulty training deep networks,. image classification problem, using convolutions,. tricks to train deep networks . . Resources: http://www.cs.utah.edu/~rajeev/cs7960/notes/ . Yonggang Cui. 1. , Zoe N. Gastelum. 2. , Ray Ren. 1. , Michael R. Smith. 2. , . Yuewei. Lin. 1. , Maikael A. Thomas. 2. , . Shinjae. Yoo. 1. , Warren Stern. 1. 1 . Brookhaven National Laboratory, Upton, USA. Mark Hasegawa-Johnson. April 6, 2020. License: CC-BY 4.0. You may remix or redistribute if you cite the source.. Outline. Why use more than one layer?. Biological inspiration. Representational power: the XOR function. Eli Gutin. MIT 15.S60. (adapted from 2016 course by Iain Dunning). Goals today. Go over basics of neural nets. Introduce . TensorFlow. Introduce . Deep Learning. Look at key applications. Practice coding in Python.