PPT-Implementing Communication-Avoiding Algorithms

Jim Demmel EECS amp Math Departments UC Berkeley Why avoid communication Communication moving data Between level of memory hierarchy Between processors over a network Running time of an algorithm is sum of 3 terms. for Linear Algebra and Beyond. Jim . Demmel. EECS & Math Departments. UC Berkeley. 2. Why avoid communication? (1/3). Algorithms have two costs (measured in time or energy):. Arithmetic (FLOPS). Communication: moving data between . Multigrid. Erin . C. . Carson. 1. Samuel Williams. 2. , Michael Lijewski. 2. , Nicholas Knight. 1. , . Ann . S. . Almgren. 2. , James Demmel. 1. , and Brian Van Straalen. 1,2. 1. University of California, Berkeley, USA. Avoiding Run-on Sentences. The length of a sentence has nothing to do with whether or not a sentence is considered a run-on. An over-exuberant, run-off-at-the-mouth, 400-word gorilla of a sentence can be structurally fine. A . Algorithms. for. Dense Linear Algebra. Jim . Demmel. CS294, Lecture . #4 . Fall, 2011. Communication-Avoiding Algorithms. www.cs.berkeley.edu/~odedsc/CS294. Based on:. Bootcamp. 2011, CS267, Summer-school 2010, many papers. Jayesh Krishna,. 1. Pavan Balaji,. 1. Ewing Lusk,. 1. . Rajeev Thakur,. 1. Fabian Tillier. 2. 1. Argonne National Laboratory, Argonne, IL, USA. 2. Microsoft Corporation, Redmond, WA, USA. 2. Windows and HPC. Erin Carson, Jim Demmel, Laura . Grigori. , Nick Knight, . Penporn. . Koanantakool. , . Oded. Schwartz, . Harsha. . Simhadri. Slides based on. ASPIRE Retreat, June 2015. 1. Outline. Strassen.  . Implementation Team (VCIT):. Student Services. Fall 2011 Update. All-Campus Meeting. November 29, 2011.  . Ann Garnsey-Harter, Gary Kalbfleisch, Amy Kinsel, Chris Melton, Stuart Trippel, Alicia Zweifach. Multigrid. Erin . C. . Carson. 1. Samuel Williams. 2. , Michael Lijewski. 2. , Nicholas Knight. 1. , . Ann . S. . Almgren. 2. , James Demmel. 1. , and Brian Van Straalen. 1,2. 1. University of California, Berkeley, USA. Iterative Methods. Erin Carson. UC Berkeley Parallel Computing Lab. BeBop. Group. Discovery 2015: HPC and Cloud Computing. Workshop, June 2011. President . Obama. cites Communication Avoiding algorithms in the FY 2012 Department of Energy Budget Request to Congress:. Multigrid. Erin . C. . Carson. 1. Samuel Williams. 2. , Michael Lijewski. 2. , Nicholas Knight. 1. , . Ann . S. . Almgren. 2. , James Demmel. 1. , and Brian Van Straalen. 1,2. 1. University of California, Berkeley, USA. Krylov. . s. ubspace . m. ethods . Erin Carson and James . Demmel. Householder Symposium XIX. June 8-13, 2014, Spa, Belgium. 2. Model Problem: 2D . Poisson on . grid. , . . .. . Equilibration . (diagonal scaling) used. . Envelope Communication . BEC Symposium . Mike McKinnon. General Superintendent. 35 . Yrs. in industry, 30 . yrs. Hoar, 20 years in Houston. Superintendent, not a presenter, I'm a builder!!. Walk fast, talk fast, and look worried. Multigrid. Erin . C. . Carson. 1. Samuel Williams. 2. , Michael Lijewski. 2. , Nicholas Knight. 1. , . Ann . S. . Almgren. 2. , James Demmel. 1. , and Brian Van Straalen. 1,2. 1. University of California, Berkeley, USA. -EJ/CUGUStudent Engineer III/IVPosition DescriptionThis position will be responsible for conducting research and preparing technical reports on environmental and social justice related policies strate