PPT-CS 6501: Deep Learning

for Computer Graphics Basics of Machine Learning Connelly Barnes Overview Supervised unsupervised and reinforcement learning Simple learning models Clustering Linear regression Linear Support Vector Machines SVM. Adam Coates. Stanford University. (Visiting Scholar: Indiana University, Bloomington). What do we want ML to do?. Given image, predict complex high-level patterns:. Object recognition. Detection. Segmentation. Quoc V. Le. Stanford University and Google. Purely supervised. Quoc V. . Le. Almost abandoned between 2000-2006. - . Overfitting. , slow, many local minima, gradient vanishing. In 2006, Hinton, et. al. proposed RBMs to . Early Work. Why Deep Learning. Stacked Auto Encoders. Deep Belief Networks. CS 678 – Deep Learning. 1. Deep Learning Overview. Train networks with many layers (vs. shallow nets with just a couple of layers). Hongning Wang. CS@UVa. Today’s lecture. k. -means clustering . A typical . partitional. . clustering . algorithm. Convergence property. Expectation Maximization algorithm. Gaussian mixture model. . to Speech . EE 225D - . Audio Signal Processing in Humans and Machines. Oriol Vinyals. UC Berkeley. This is my biased view about deep learning and, more generally, machine learning past and current research!. Presenter: . Yanming. . Guo. Adviser: Dr. Michael S. Lew. Deep learning. Human. Computer. 1:4. Human . v.s. . Computer. Deep learning. Human. Computer. 1:4. Human . v.s. . Computer. Deep Learning. Why better?. Neural Networks from Scratch. Presented . By. Wasi Uddin . Ahmad. 3. rd. November, 2016. Written By. Denny . Britz. http://www.wildml.com/2015/09/implementing-a-neural-network-from-scratch/. "Lane, Mary E. . CS 501:CS Seminar. Min Xian. Assistant Professor. Department of Computer Science. University of Idaho. Image from NVIDIA. Researchers:. Geoff Hinton. Yann . LeCun. Andrew Ng. Yoshua. . Bengio. …. New-Generation Models & Methodology for Advancing . AI & SIP. Li Deng . Microsoft Research, Redmond, . USA. Tianjin University, July 2-5, 2013. (including joint work with colleagues at MSR, U of Toronto, etc.) . Topic 3. 4/15/2014. Huy V. Nguyen. 1. outline. Deep learning overview. Deep v. shallow architectures. Representation learning. Breakthroughs. Learning principle: greedy layer-wise training. Tera. . scale: data, model, . Lecture 2: N-gram Kai-Wei Chang CS @ University of Virginia kw@kwchang.net Couse webpage: http://kwchang.net/teaching/NLP16 1 CS 6501: Natural Language Processing This lecture Language Models What are N-gram models? CS@UVa. Today’s lecture. Support vector machines. Max margin classifier. Derivation of linear SVM. Binary and multi-class cases. Different types of losses in discriminative models. Kernel method. Non-linear SVM. Assistant Professor. Computer Science and Engineering Department. Indian Institute of Technology Kharagpur. http://cse.iitkgp.ac.in/~adas/. Biological Neural Network. Image courtesy: F. . A. . Makinde. Hongning Wang. CS@UVa. Today’s lecture. Lexical semantics. Meaning of words. Relation between different meanings. WordNet. An ontology structure of word senses. Similarity between words. Distributional semantics.