PPT-Introduction to CUDA Programming

Introduction to CUDA Programming CUDA Programming Introduction Andreas Moshovos Winter 2009 Some slidesmaterial from UIUC course by WenMei Hwu and David Kirk UCSB course by Andrea Di Blas Universitat Jena by Waqar Saleem. heterogeneous programming. Katia Oleinik. koleinik@bu.edu. Scientific Computing and Visualization. Boston . University. Architecture. NVIDIA Tesla M2070: . Core clock: 1.15GHz . Single instruction . 448 CUDA cores . CUDA Platform. CUDA Parallel Computing Platform. . Hardware . . . Capabilities. GPUDirect. SMX. Dynamic Parallelism. HyperQ. Programming . Approaches. Libraries. “Drop-in” Acceleration. Martin Burtscher. Department of Computer Science. High-End CPUs and GPUs. Xeon X7550 Tesla C2050. Cores 8 (superscalar) 448 (simple). Active threads 2 per core 48 per core. Frequency 2 GHz 1.15 GHz. Sathish. . Vadhiyar. Parallel Programming. GPU. Graphical Processing Unit. A single GPU consists of large number of cores – hundreds of cores.. Whereas a single CPU can consist of 2, 4, 8 or 12 cores. Introduction to Programming Massively Parallel Graphics processors. Andreas . Moshovos. moshovos@eecg.toronto.edu. ECE, Univ. of Toronto. Summer 2010. Some slides/material from:. UIUC course by . Wen. on . Ubuntu. Cuda. download site. . https://developer.nvidia.com/cuda-downloads. $ . sudo. . dpkg. -. i. cuda-repo-ubuntu1404_7.5-18_amd64.deb . $ . sudo. apt-get update . $ . sudo. apt-get install . introduce the use of multiple CUDA streams to overlap memory transfers with kernel computations.. Also introduced is paged-locked memory. 2. Page-locked host memory. (also called pinned host memory). K. ainz. Overview. About myself. Motivation. GPU hardware and system architecture. GPU programming languages. GPU programming paradigms. Pitfalls and best practice. Reduction and tiling examples. State-of-the-art . What is CUDA?. Data Parallelism. Host-Device model. Thread execution. Matrix-multiplication . GPU revised!. What is CUDA?. C. ompute . D. evice . U. nified . A. rchitecture. Programming interface to GPU. Defines much more than an API. A language . Hardware Specifications. PA0. Let’s look into your first assignment and figure some things out.. HELLOCUDA.CU. HELLOCUDA.CU. Pointers to GPU land. dev_a. Martin Burtscher. Department of Computer Science. High-end CPU-GPU Comparison. . Xeon 8180M. . Titan V. Cores 28 5120 (+ 640). Active threads 2 per core 32 per core. Frequency 2.5 (3.8) GHz 1.2 (1.45) GHz. Cliff Woolley NVIDIADeveloper Technology GroupGPUCPUGPGPU Revolutionizes ComputingLatency Processor Throughput processorLow Latency or High ThroughputCPUOptimized for low-latency access to cached dat The Desired Brand Effect Stand Out in a Saturated Market with a Timeless Brand The Desired Brand Effect Stand Out in a Saturated Market with a Timeless Brand