PPT-Reining in the Outliers in MapReduce

Jobs using Mantri Ganesh Ananthanarayanan Srikanth Kandula Albert Greenberg Ion Stoica Yi Lu Bikas Saha Ed Harris UC Berkeley Microsoft 1 MapReduce Jobs. regression models, the outliers can affect the estimated correlation coefficient [10]. Presence of outliers in training and testing data can bring about several difficulties for methods of decision- and . Hadoop. Debapriyo Majumdar. Data Mining – Fall 2014. Indian Statistical Institute Kolkata. November 10, 2014. Let’s keep the intro short. Modern data mining: process immense amount of data quickly. , Collective Communication, and Services. Oral Exam, . Bingjing. Zhang. Outline. MapReduce. MapReduce. Frameworks. Iterative . MapReduce. Frameworks. Frameworks Based on . MapReduce. and Alternatives. Simplified Data Processing on Large . Clusters. by Jeffrey Dean and Sanjay . Ghemawa. Presented by Jon Logan. Outline. Problem Statement / Motivation. An Example Program. MapReduce. . vs. Hadoop. GFS / HDFS. Webinar basics. How do I ask questions during the webinar?. Recorded webinar and PowerPoint slides will be available after the webinar.. Special thanks to our funders:. Your presenters. Amy Downs. Senior Director for . Parallel Computing. MapReduce. Examples. Parallel Efficiency. Assignment. Parallel Computing. Parallel efficiency with . p. processors. Traditional parallel computing:. focus on compute intensive tasks. The Story of Success. By Malcolm Gladwell . What is an Outlier?. out-li-. er. . (n.). 1. something that is situated away from or classed differently from a main or related body. . 2. a statistical observation that is markedly different in value from the others of the sample. . Presented By. Shefali. . Gundecha. Srinivas . Narne. Yash. Kulkarni. Papers to be discussed…. Y. Shan, B. Wang, J. Yan, Y. Wang, N. Xu, and H. Yang, . " FPMR: MapReduce Framework on FPGA: A Case Study of . Yasin N. Silva and Jason Reed. Arizona State University. 1. This work is licensed under a Creative Commons Attribution-. NonCommercial. -. ShareAlike. 4.0 International License. See http://creativecommons.org/licenses/by-nc-sa/4.0/ for details.. Jobs using . Mantri. Ganesh Ananthanarayanan. †. , Srikanth Kandula*, Albert Greenberg*, Ion Stoica. †. , Yi Lu*, Bikas Saha*, Ed Harris*. . †. UC Berkeley * . Microsoft. 1. MapReduce Jobs. ”. Cathy O’Neil & Rachel . Schutt. , 2013. R & Hadoop. Compute squares. 2. R. # create a list of 10 integers. ints. <- 1:10. # equivalent to . ints. <- c(1,2,3,4,5,6,7,8,9,10). # compute the squares. Jimmy Lin. The iSchool. University of Maryland. Monday, March 30, 2009. This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States. See http://creativecommons.org/licenses/by-nc-sa/3.0/us/ for details. Source. MapReduce. : Simplified Data Processing in Large Clusters. . Jefferey. Dean and Sanjay . Ghemawat. . OSDI 2004. Example Scenario. 3. Genome data from roughly . one million users. 125 MB of data per user. MapReduce. Architecture. MapReduce. Internals. MapReduce. Examples. JobTracker. Interface. MapReduce. : A Real World Analogy. Coins Deposit. ?. MapReduce. : A Real World Analogy. Coins Deposit. Coins Counting Machine.