PPT-Ceph: A Scalable, High-Performance Distributed File System

Priya Bhat Yonggang Liu Jing Qin Content 1 Ceph Architecture 2 Ceph Components 3 Performance Evaluation 4 Ceph Demo 5 Conclusion Ceph Architecture What is Ceph Ceph is a distributed file system that provides excellent performance scalability and reliability. Why not primary copy, as in Harp? Work out our own design... How to divide data among the network disks. Why does the Frangipani / Petal split make sense? Performance vs Harp? Reliability vs Harp? Distributed File Access Mahadev SatyanarayananCarnegie Mellon University F or the users of a distributed systemto collaborate effectively, the abil- ity the last decade, distributed file systemsbased Cluster File Systems, Inc. Abstract: Today's network-oriented computing environments require high-performance, network-aware file systems that can satisfy both the data storage requirements of indiv from . Leslie . Lamport. Who is he?. Leslie . Lamport. (born February 7, 1941 in New York City) is an American computer scientist. . Lamport. is best known for his seminal work in distributed systems and as the initial developer of the document preparation system . Deployment at Target:. Best Practices and Lessons Learned. Agenda. 2. Introduction. Will Boege. Sr. Technical Architect. RAPID Team (Private Cloud and Automation). Agenda. 3. @. . First . Ceph. Environment at Target went live in October of 2014. Dimension Reduction. Student: . Seung-Hee. . Bae. Advisor: . Dr. Geoffrey C. Fox. School of Informatics and Computing. Pervasive Technology Institute. Indiana University. Thesis Defense, Jan. 17, 2012. Hydrological Terrain Analysis Service on XSEDE. 1. Ye . Fan. 1. , . Yan Liu. 1. , . Shaowen. Wang. 1. , David Tarboton. 2. , Ahmet Yildirim. 2. , . Nancy . Wilkins-Diehr. 3. 1 . University of Illinois at Urbana-Champaign. Group ID: 4. Baolin Wu, . Liushan. Yang, . Pengyu. . Ji. Motivation & Goals. Distributed File System provides more reliable service.. Cloud Storage Service is very popular. Google Cloud Storage, Dropbox, Amazon SC3 have many users.. DISTRIBUTED FILE SYSTEM. S. A. Weil, S. A. Brandt, E. L. Miller. D. D. E. Long, C. . Maltzahn. U. C. Santa Cruz . OSDI. 2006. Paper highlights . Yet another distributed file system using . object storage devices. Date Description August 2016 Initial release THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY, AND MAY CONTAIN TYPOGRAPHICAL ERRORS AND TECHNICAL INACCURACIES. THE CONTENT IS PROVIDED AS IS, WIT e. Echo. Big ceph cluster for WLCG Tier-1 object storage (and other users). 181 Storage nodes. 4700 OSDs (6-12TB). 36/28PB raw/usable – 16PB data stored. Density and throughput over latency. EC 8+3 . *. Dr. Mark K. Seager. ASCI Tera-scale Systems PI. Lawrence Livermore National Laboratory. POBOX 808, L-60. Livermore, CA 94550. seager@llnl.gov. 925-423-3141. *. Work performed under the auspices of the U.S. Department of Energy by Lawrence Livermore National Laboratory under Contract W-7405-Eng-48.. Metdata. Management for Distributed File Systems. Thomas Kao. 1. Background. Scalable solutions provided for data storage, why not file systems?. 2. Motivation. O. ften . bottlenecked by the metadata management . Stephen . Soltes. z. , Herbert . Potzl. , Marc E. . Fiuczynski. , Andy . Bavier. , Larry Peterson. Stephen . Soltesz. , Herbert . Pötzl. , Marc E. . Fiuczynski. , Andy . Bavier. , and Larry Peterson. 2007. Container-based operating system...