PDF-CUDA Overview

Cliff Woolley NVIDIADeveloper Technology GroupGPUCPUGPGPU Revolutionizes ComputingLatency Processor Throughput processorLow Latency or High ThroughputCPUOptimized for lowlatency access to cached dat. Basically a child CUDA Kernel can be called from within a parent CUDA kernel and then optionally synchronize on the completion of that child CUDA Kernel The parent CUDA kernel can consume the output produced from the child CUDA Kernel all withou t heterogeneous programming. Katia Oleinik. koleinik@bu.edu. Scientific Computing and Visualization. Boston . University. Architecture. NVIDIA Tesla M2070: . Core clock: 1.15GHz . Single instruction . 448 CUDA cores . . Acknowledgement: the lecture materials are based on the materials in NVIDIA teaching center CUDA course materials, including materials from Wisconsin (. Negrut. ), North Carolina Charlotte (. Wikinson. ITS Research Computing. Mark Reed . Objectives. Learn why computing with accelerators is important. Understand accelerator hardware. Learn what types of problems are suitable for accelerators. Survey the programming models available. © Dan Negrut, . 2012. UW-Madison. Dan Negrut. Simulation-Based Engineering Lab. Wisconsin Applied Computing Center. Department of Mechanical Engineering. Department of . Electrical and Computer Engineering. Håkon Kvale . Stensland. iAD-lab, Department for Informatics. Basic 3D Graphics Pipeline. Application. Scene Management. Geometry. Rasterization. Pixel Processing. ROP/FBI/Display. Frame. Buffer. Memory. Overview. GPU Ocelot overview. Building, configuring, and executing Ocelot programs. Ocelot Device Interface and CUDA Runtime API. Ocelot PTX Internal Representation. PTX Pass Manager. 2. Ocelot: Multiplatform Dynamic Compilation. Håkon Kvale . Stensland. Simula Research Laboratory. PC Graphics Timeline. Challenges. :. Render infinitely complex scenes. And extremely high resolution. In 1/60. th. of one second (60 frames per second). on . Ubuntu. Cuda. download site. . https://developer.nvidia.com/cuda-downloads. $ . sudo. . dpkg. -. i. cuda-repo-ubuntu1404_7.5-18_amd64.deb . $ . sudo. apt-get update . $ . sudo. apt-get install . introduce the use of multiple CUDA streams to overlap memory transfers with kernel computations.. Also introduced is paged-locked memory. 2. Page-locked host memory. (also called pinned host memory). ITS Research Computing. Mark Reed . Objectives. Learn why computing with accelerators is important. Understand accelerator hardware. Learn what types of problems are suitable for accelerators. Survey the programming models available. What is CUDA?. Data Parallelism. Host-Device model. Thread execution. Matrix-multiplication . GPU revised!. What is CUDA?. C. ompute . D. evice . U. nified . A. rchitecture. Programming interface to GPU. Defines much more than an API. A language . Hardware Specifications. PA0. Let’s look into your first assignment and figure some things out.. HELLOCUDA.CU. HELLOCUDA.CU. Pointers to GPU land. dev_a. Agenda. Text book / resources. Eclipse . Nsight. , NVIDIA Visual Profiler. Available libraries. Questions. Certificate dispersal. (Optional) Multiple GPUs: Where’s Pixel-Waldo?. Text Book / Resources.