PDF-Improving Cache Performance

Average memoryaccess time Hit time Miss rate x Miss penalty ns or clocks. Client sends HTTP request 2 Web Cache responds immediately if cached object is available 3 If object is not in cache W eb Cache requests object from Application Server 4 Application Server generates response may include Database queries 5 Applicatio Message Passing Sharedmemory single copy of shared data in memory threads communicate by readingwriting to a shared location Messagepassing each thread has a copy of data in its own private memory that other threads cannot access threads communicate Marc De Melo. Outline. Non-Uniform Cache Architecture (NUCA). Cache Coherence. Implementation of directories in multicore architecture. 2. Non-Uniform Cache Architecture [1]. Uniform Cache Architecture. Replacement Using Re-Reference . Interval . Prediction (RRIP. ). Aamer Jaleel, Kevin B. Theobald. , . Simon C. Steely Jr. , Joel . Emer. Intel . Corporation. 1. / 20. The ACM IEEE International Symposium on Computer Architecture . Hardware Accelerators. Yakun. Sophia Shao, Sam Xi,. Viji. . Srinivasan. , . Gu-Yeon. Wei, David Brooks. More accelerators.. Out-of-Core. Accelerators. Maltiel. Consulting . estimates. 2. [Die photo from . Professor Alvin R. Lebeck. Computer Science 220. Fall . 2008. Admin. Work . on Projects. Read . NUCA paper. Review: ABCs of caches. Associativity. Block size. Capacity. Number of sets S = C/(BA). 1-way (Direct-mapped). Mark Gebhart. 1,2 . Stephen W. Keckler. 1,2. Brucek Khailany. 2. Ronny Krashinsky. 2. . William J. Dally. 2,3. 1. The University of Texas at Austin . 2. NVIDIA . 3. Stanford University. Methodology. Bob Beauchemin. Developer Skills Partner, . SQLskills. Session Code: DAT405. Agenda. Peeking Into the Plan Cache. Understand Plans and the Cache. Plan Cache DMVs. Parameterization and Parameter Sniffing. Aamer . Jaleel*. , . Joseph . Nuzman. , Adrian . Moga. ,. Simon Steely Jr., Joel . Emer. *. Intel Corporation, . VSSAD. ( . *. Now at NVIDIA ). International Symposium on High Performance Computer Architecture (HPCA-2015). Characterizing Roles of Front-end Servers in . End. -to-. End. . Performance of Dynamic Content Distribution . 46842197. Li . ZHANG. 78884704 . . Dakuo WANG. 30165502 . . Xuejie. SUN. Why it works: The principle of locality. How it . works. : The architectural details. Von Neumann Architecture. Cost/performance analysis is a constant theme in computer engineering ‒ which is why the proper choice of performance metric is important. With a superscalar, we might need to accommodate more than 1 per cycle. Typical server and . m. obile device. memory hierarchy. c. onfiguration with. b. asic sizes and. access times. PCs and laptops will. March 28, 2017. Agenda. Review from last lecture. Cache access. Associativity. Replacement. Cache Performance. Cache Abstraction and Metrics. Cache hit rate = (# hits) / (# hits # misses) = (# hits) / (# accesses). Distributed Auto-Tuning. Samuel . Williams, Leonid . Oliker. Jonathan Carter, John . Shalf. 1. Lawrence Berkeley National Laboratory. . SWWilliams@lbl.gov. Introduction. Management of . data locality and data movement .