PPT-Lecture 2: Learning with neural networks

Deep Learning UvA UVA Deep Learning COURSE Efstratios Gavves amp Max Welling LEARNING WITH NEURAL NETWORKS PAGE 1 Machine Learning Paradigm for Neural Networks The Backpropagation algorithm for learning with a neural network. Easy to understand Easy to code by hand Often used to represent inputs to a net Easy to learn This is what mixture models do Each cluster corresponds to one neuron Easy to associate with other representations or responses But localist models are ver 1. Recurrent Networks. Some problems require previous history/context in order to be able to give proper output (speech recognition, stock forecasting, target tracking, etc.. One way to do that is to just provide all the necessary context in one "snap-shot" and use standard learning. Cost function. Machine Learning. Neural Network (Classification). Binary classification. . . 1 output unit. Layer 1. Layer 2. Layer 3. Layer 4. Multi-class classification . (K classes). K output units. Machine . Learning. 1. Last Time. Perceptrons. Perceptron. Loss vs. Logistic Regression Loss. Training . Perceptrons. and Logistic Regression Models using Gradient Descent. 2. Today. Multilayer Neural Networks. Table of Contents. Part 1: The Motivation and History of Neural Networks. Part 2: Components of Artificial Neural Networks. Part 3: Particular Types of Neural Network Architectures. Part 4: Fundamentals on Learning and Training Samples. Week 5. Applications. Predict the taste of Coors beer as a function of its chemical composition. What are Artificial Neural Networks? . Artificial Intelligence (AI) Technique. Artificial . Neural Networks. Deep Neural Networks . Huan Sun. Dept. of Computer Science, UCSB. March 12. th. , 2012. Major Area Examination. Committee. Prof. . Xifeng. . Yan. Prof. . Linda . Petzold. Prof. . Ambuj. Singh. Deep . Learning. James K . Baker, Bhiksha Raj. , Rita Singh. Opportunities in Machine Learning. Great . advances are being made in machine learning. Artificial Intelligence. Machine. Learning. After decades of intermittent progress, some applications are beginning to demonstrate human-level performance!. Introduction 2. Mike . Mozer. Department of Computer Science and. Institute of Cognitive Science. University of Colorado at Boulder. Hinton’s Brief History of Machine Learning. What was hot in 1987?. Dr David Wong. (With thanks to Dr Gari Clifford, G.I.T). The Multi-Layer Perceptron. single layer can only deal with linearly separable data. Composed of many connected neurons . Three general layers; . networks deep recurrent and dynamical to perform a variety of tasks using evolutionary and reinforcement learning algorithms Analyzed optimized networks using statistical and information theoretic too Mark Hasegawa-Johnson. April 6, 2020. License: CC-BY 4.0. You may remix or redistribute if you cite the source.. Outline. Why use more than one layer?. Biological inspiration. Representational power: the XOR function. Eli Gutin. MIT 15.S60. (adapted from 2016 course by Iain Dunning). Goals today. Go over basics of neural nets. Introduce . TensorFlow. Introduce . Deep Learning. Look at key applications. Practice coding in Python. . Introduction. Eren Gultepe. Adapted from . Roger . Grosse. How . to . get . free. . GPUs. Colab . (Recommended) . Google . Colab . is . a . web-based . iPython . Notebook . service . that . has .