PPT-Cache

Memory and Performance Many of the following slides are taken with permission from Complete Powerpoint Lecture Notes for Computer Systems A Programmers Perspective CSAPP Randal E Bryant. Client sends HTTP request 2 Web Cache responds immediately if cached object is available 3 If object is not in cache W eb Cache requests object from Application Server 4 Application Server generates response may include Database queries 5 Applicatio Message Passing Sharedmemory single copy of shared data in memory threads communicate by readingwriting to a shared location Messagepassing each thread has a copy of data in its own private memory that other threads cannot access threads communicate  Stefan . Schackow. Program Manager. Microsoft Corporation. PC41. What's the current state?. Why is it changing?. How are we changing it?. .NET Framework Caching. A great in-memory object cache in ASP.NET. Andrew Putnam, Susan Eggers. Dave Bennett, Eric Dellinger, Jeff Mason, . Henry Styles, . Prasanna. . Sundararajan. , Ralph Wittig. University of . Washington. -- CSE. Xilinx Research Labs. High-Performance Computing. Technique MR MP HT Complexity. Larger Block Size + – . 0. Higher Associativity + – 1. Victim Caches + 2. Pseudo-Associative Caches + 2. HW Prefetching of Instr/Data + 2. Compiler Controlled Prefetching + . OutlineoftalkCache-obliviousmodelCache-obliviousresultsCache-obliviouspriorityqueuesFunnelheap Memory Wall . The . growing disparity of speed between CPU and memory outside the CPU . chip. Bandwidth wall: limited . communication bandwidth beyond chip . boundaries. Solution . Memory hierarchy . Why it works: The principle of locality. How it . works. : The architectural details. Von Neumann Architecture. Cost/performance analysis is a constant theme in computer engineering ‒ which is why the proper choice of performance metric is important. With a superscalar, we might need to accommodate more than 1 per cycle. Typical server and . m. obile device. memory hierarchy. c. onfiguration with. b. asic sizes and. access times. PCs and laptops will. Direct-mapped caches. Set-associative caches. Impact of caches on performance. CS 105. Tour of the Black Holes of Computing. Cache Memories. C. ache memories . are small, fast SRAM-based memories managed automatically in hardware. March 28, 2017. Agenda. Review from last lecture. Cache access. Associativity. Replacement. Cache Performance. Cache Abstraction and Metrics. Cache hit rate = (# hits) / (# hits # misses) = (# hits) / (# accesses). Internet . has many user. Issues with access latency (lag). Server crashing. How to solve?. One solution, Web Cache. Web Cache. What is web cache?. Cache “. a place of . storage”. Web cache – “a . Cache Memory and Performance Many of the following slides are taken with permission from Complete Powerpoint Lecture Notes for Computer Systems: A Programmer's Perspective (CS:APP) Randal E. Bryant TLC: A Tag-less Cache for reducing dynamic first level Cache Energy Presented by Rohit Reddy Takkala Introduction First level caches are performance critical and are therefore optimized for speed. Modern processors reduce the miss ratio by using set-associative caches and optimize latency by reading all ways in parallel with the TLB(Translation Lookaside Buffer) and tag lookup.