PPT-Twister: A Runtime for Iterative MapReduce

Author : alida-meadow | Published Date : 2016-08-01

Jaliya Ekanayake Community Grids Laboratory Digital Science Center Pervasive Technology Institute Indiana University HPDC 2010 MAPREDUCE10 Workshop Chicago 06222010

Presentation Embed Code

Download Presentation

Download Presentation The PPT/PDF document "Twister: A Runtime for Iterative MapRedu..." is the property of its rightful owner. Permission is granted to download and print the materials on this website for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.

Twister: A Runtime for Iterative MapReduce: Transcript

Jaliya Ekanayake Community Grids Laboratory Digital Science Center Pervasive Technology Institute Indiana University HPDC 2010 MAPREDUCE10 Workshop Chicago 06222010 Acknowledgements to. S. A. L. S. A. . HPC Group . http://. salsahpc.indiana.edu. School of Informatics and Computing. Indiana University. Judy . Qiu. . Thilina. . Gunarathne. . CAREER Award. Outline. Iterative . NSF Cloud PI Workshop. March 17, 2011. . Judy Qiu. http://salsahpc.indiana.edu . School of Informatics and Computing. Indiana University. Twister . v0.9. March 15, 2011. New . Infrastructure . for . Computations. K-means. Performance of K-Means. Smith Waterman is a non iterative case and of course runs fine. Matrix Multiplication . 64 cores. Square blocks Twister. Row/Col . decomp. Twister. CloudCom. 2010. Indianapolis, Indiana, USA. Nov 30 – Dec 3, 2010. Azure . MapReduce. AzureMapReduce. A . MapRedue. runtime for Microsoft Azure using Azure cloud services. Azure Compute. Azure BLOB storage for in/out/intermediate data storage. Science Applications. http://salsahpc.indiana.edu . School of Informatics and Computing. Indiana University. Application Classes. 1. Synchronous. Lockstep Operation as in SIMD architectures. SIMD. 2. Data Enabled . S. cience. S. A. L. S. A. . HPC Group . http://. salsahpc.indiana.edu. School of Informatics and Computing. Indiana University. Bioinformatics Pipeline. Gene Sequences (N = 1 Million). Yang . Ruan. , . Zhenhua . Guo. , . Yuduo. Zhou, Judy . Qiu. , Geoffrey Fox. Indiana . University, US. Outline. Introduction and Background. MapReduce. Iterative MapReduce. Distributed Workflow . Management Systems. Mega 10^6. Giga 10^9. Tera. 10^12. Peta. 10^15. Pig Latin. Understanding . MapReduce. . in Context. Linux HPC. Bare-system. Amazon Cloud. Windows Server HPC. Bare-system. Virtualization. Cross Platform Iterative . MapReduce. on Multicore Clusters. UMBC, Maryland. Judy Qiu. http://salsahpc.indiana.edu . School . of Informatics and Computing. Pervasive Technology Institute. Indiana University. Important Trends. S. cience. S. A. L. S. A. . HPC Group . http://. salsahpc.indiana.edu. School of Informatics and Computing. Indiana University. Bioinformatics Pipeline. Gene Sequences (N = 1 Million). Distance Matrix. http. ://. SALSA. hpc.indiana.edu. . School of Informatics and Computing. Indiana University. Indexed. HBase. Analysis Tools for . Data Enabled Science. Summer Workshop on Algorithms and . Cyberinfrastructure. Computations. K-means. Performance of K-Means. Smith Waterman is a non iterative case and of course runs fine. Matrix Multiplication . 64 cores. Square blocks Twister. Row/Col . decomp. Twister. nabling HPC-Cloud Interoperability. S. A. L. S. A. . HPC Group . http://salsahpc.indiana.edu. School of Informatics and Computing. Indiana University. Workshop on . Petascale. Data Analytics: Challenges, and . MapReduce. Fei. . Teng. Doga Tuncay. Outline. Goal. Genetic Algorithm. Why . MapReduce. . Hadoop. /Twister. Performance Issues. References. Goal. Implement a genetic algorithm on Twister to prove that Twister is an ideal .

Download Document

Here is the link to download the presentation.
"Twister: A Runtime for Iterative MapReduce"The content belongs to its owner. You may download and print it for personal use, without modification, and keep all copyright notices. By downloading, you agree to these terms.