PPT-GPU/CUDA Instrumentation Notes

Current Goals Generate stacktraces of GPU executions and associate GPU call chains with CPU call graphs Particular interest on how to determine call chains when inlined GPU functions are used. Basically a child CUDA Kernel can be called from within a parent CUDA kernel and then optionally synchronize on the completion of that child CUDA Kernel The parent CUDA kernel can consume the output produced from the child CUDA Kernel all withou t heterogeneous programming. Katia Oleinik. koleinik@bu.edu. Scientific Computing and Visualization. Boston . University. Architecture. NVIDIA Tesla M2070: . Core clock: 1.15GHz . Single instruction . 448 CUDA cores . . Acknowledgement: the lecture materials are based on the materials in NVIDIA teaching center CUDA course materials, including materials from Wisconsin (. Negrut. ), North Carolina Charlotte (. Wikinson. © Dan Negrut, . 2012. UW-Madison. Dan Negrut. Simulation-Based Engineering Lab. Wisconsin Applied Computing Center. Department of Mechanical Engineering. Department of . Electrical and Computer Engineering. Day Monday Notes: Tuesday Notes: Wednesday Notes: Thursday Notes: Friday Notes: Saturday Notes: Sunday Notes: Workout Intervals Steady row Repeat four times for one set then take a break of 3 minu Håkon Kvale . Stensland. iAD-lab, Department for Informatics. Basic 3D Graphics Pipeline. Application. Scene Management. Geometry. Rasterization. Pixel Processing. ROP/FBI/Display. Frame. Buffer. Memory. Håkon Kvale . Stensland. Simula Research Laboratory. PC Graphics Timeline. Challenges. :. Render infinitely complex scenes. And extremely high resolution. In 1/60. th. of one second (60 frames per second). on . Ubuntu. Cuda. download site. . https://developer.nvidia.com/cuda-downloads. $ . sudo. . dpkg. -. i. cuda-repo-ubuntu1404_7.5-18_amd64.deb . $ . sudo. apt-get update . $ . sudo. apt-get install . introduce the use of multiple CUDA streams to overlap memory transfers with kernel computations.. Also introduced is paged-locked memory. 2. Page-locked host memory. (also called pinned host memory). What is CUDA?. Data Parallelism. Host-Device model. Thread execution. Matrix-multiplication . GPU revised!. What is CUDA?. C. ompute . D. evice . U. nified . A. rchitecture. Programming interface to GPU. Defines much more than an API. A language . Hardware Specifications. PA0. Let’s look into your first assignment and figure some things out.. HELLOCUDA.CU. HELLOCUDA.CU. Pointers to GPU land. dev_a. Agenda. Text book / resources. Eclipse . Nsight. , NVIDIA Visual Profiler. Available libraries. Questions. Certificate dispersal. (Optional) Multiple GPUs: Where’s Pixel-Waldo?. Text Book / Resources. Cliff Woolley NVIDIADeveloper Technology GroupGPUCPUGPGPU Revolutionizes ComputingLatency Processor Throughput processorLow Latency or High ThroughputCPUOptimized for low-latency access to cached dat C. Scheuerlein. with. input . from. L. Grand Clement, S. . Izquierdo Bermudez. , A. Foussat, T. Nakamoto, H. Prin, A. Milanese, M. Ferrari . HL-LHC instrumentation review, 1 September 2020. Outline.