PPT-CS252 Graduate Computer Architecture Lecture 19 April 4th, 2012 Bus-Based Shared Memory

Lecture 19 April 4 th 2012 BusBased Shared Memory Cont Distributed Shared Memory Prof John D Kubiatowicz httpwwwcsberkeleyedukubitroncs252 Recall Natural Extensions of Memory System. Shared memory. Process A. Process B. Physical Memory. Virtual address space A. Virtual address space B. Share. Share. Share. Instruction memory. Data. Instruction memory. Data. Create a shared memory region. Distributed Shared Memory. Shared Memory. Shared memory programs are easier to write. Multiprocessor systems. Message passing systems:. - no physically shared memory. - need to provide an abstraction of shared memory: Distributed Shared Memory. A Complete GPU Compute Architecture by NVIDIA. Tamal. . Saha. , . Abhishek. . Rawat. , Minh Le. {ts4rq, ar8eb, ml4nw}@. virginia.edu. GPU Computing. Unprecedented FP performance. Ideal for data parallel applications. Processor . Architecture . Types. Memory . Access . Architectures. Shared . Memory . Model & the . Mutex. Lecturer:. Simon Winberg. Digital Systems. EEE4084F. Attribution-. ShareAlike. 4.0 International (CC BY-SA 4.0). Acoherent. . Shared Memory?. Mark D. Hill. UW-Madison Computer Sciences. Workshop . on Negative Outcomes,. Post-mortems. , . and Experiences (NOPE). December 2015. Title/Abstract. Title: Whither . Acoherent. 1. COMET: Code Offload by. Migrating Execution Transparently. OSDI'12. Mark Gordon, Anoushe Jamshidi,. Scott Mahlke, Z. Morley Mao, and Xu Chen. University of Michigan, AT&T Labs - Research. Mark Gordon. What is Multiprocessing?. Enables several programs to run concurrently. Coordinated processing of Programs by more than one processor. Use of 2 or more CPUs within a single computer system. Ability of a system to support more than one processor and to allocate tasks between them. Clocks. External clock synchronization (. Cristian. ). Internal clock synchronization (. Gusella. & . Zatti. ). Network Time Protocol (Mills). Decisions. Agreement protocols (Fischer). Data. Distributed file . Recall: Microprocessors are classified by how memory is organized. Tightly-coupled multiprocessor systems use the same memory. They are also referred to as . shared memory multiprocessors. .. The processors do not necessarily have to share the same block of physical memory: . Lecture 12. Multithreading / Vector Processing. February 29. th. , 2012. John Kubiatowicz. Electrical Engineering and Computer Sciences. University of California, Berkeley. http://www.eecs.berkeley.edu/~kubitron/cs252. Rethinking . of . the Memory Hierarchy. Sarita. Adve, . Vikram Adve,. Rob Bocchino. , Nicholas Carter, Byn . Choi, . Ching-Tsun. Chou, . Stephen Heumann, . Nima. Honarmand, Rakesh Komuravelli, Maria Kotsifakou, . Hagersten. , . Landin. , and . Haridi. (1991). Presented by Patrick . Eibl. Outline. Basics of Cache-Only Memory Architectures. The Data Diffusion Machine (DDM). DDM Coherence Protocol. Examples of Replacement, Reading, Writing. Lecture 20. April . 9. th. , . 2012. Distributed Shared Memory. Prof John D. Kubiatowicz. http://www.cs.berkeley.edu/~kubitron/cs252. LD. 1. A .  5. LD. 2. B  7. LD. 5. B .  2. ST. 1. A,6. Lecture 21. April . 11. th. , . 2012. Distributed Shared Memory (. con’t. ). Synchronization. Prof John D. Kubiatowicz. http://www.cs.berkeley.edu/~kubitron/cs252. Recall: Sequential Consistency of Directory Protocols.