PPT-Condor and Distributed Computing

David Ríos CSCI 6175 Fall 2011 Why are we going to spend 25 minutes on Condor Agenda What is Condor Who can benefit from Condor Distributed Computer Concepts Condor Design Philosophy How Condor Works. Notification . in . Condor. By. Vidhya. . Murali. Existing Condor Notification . System. Email Notifier. . Machine. –N. . startD. . schedD. logs. Condor Pool. Goal -1. F. I. L. T. E. R. Philip Papadopoulos, . Ph.D. University of California, San Diego. San Diego Supercomputer Center. California Institute for Telecommunications and Information Technology (Calit2). Triton Resource. Large Memory PSDAF. William . Strecker. -Kellogg. Condor at the RACF. 1. Upgrade to 7.6.x. Move to 7.6.4 done in October time-frame for RHIC experiments. Everything went better than expected. 7.6.6 for ATLAS done in February, also went smoothly. Previously Covered. Some topics from the vanilla Condor operations talk apply to Condor-G. Configuration files. L. og files. Command-line tools. Job policy expressions. Where to get more help. HELD Status. An Introduction. ICE 2011. The Condor Project . (Established ‘85). Distributed High Throughput Computing . research. performed by a team of ~35 faculty, full time staff and students.. Condor is a batch computing System . Campus. Condor Week . 2010. Preston . Smith. Purdue University. Outline. Campus Grids. Condor . Nests at Purdue. Central Clusters. Computing Labs. Departmental Resources. TeraGrid. Budget Realities in 2010. Set up a large number of machines all identically configured. Connect them to a high speed LAN. And to the Internet. Accept arbitrary jobs from remote users. Run each job on one or more nodes. Entire facility probably running mix of single machine and distributed jobs, simultaneously. Early Adopter: ASU - Intel Collaboration in Parallel and Distributed Computing Yinong Chen , Eric Kostelich , Yann -Hang Lee, Alex Mahalov , Gil Speyer, and Violet R. Syrotiuk 1 st NSF /TCPP Workshop on Parallel and Distributed Computing Education ( 2002. 2008. Two local pools, a few nodes, one application. A pioneer.. Nine global pools, 15k nodes, over 20 apps. An also ran.. Buddy, can . ya. spare a host?. Chomping at the bit for the next release.. -Style. Peter Couvares. Syracuse . University, LIGO . Scientific . Collaboration. Condor Week 2013. 1 May 2013. Who am I. ? What is LIGO?. Former Condor Team member (‘99-’08).. Now at Syracuse . Dr. . Barsha. . Mitra. CSIS . Dept. , BITS Pilani, Hyderabad Campus. Introduction. Course ID: SS ZG526, Title: Distributed Computing. allows for flexibly sharing resources (e.g., files and multimedia documents) stored across network-wide computers. , . DiaGrid. and Beyond. April 21, 2009. Preston Smith . Purdue University. Condor Week 2009. No Cycle Left Behind. No Byte Left Unexplored. Condor Week 2009. At . BoilerGrid. , we don’t make a lot of the products in our grid.. Cast of thousands. Mihai. Pop. Michael Schatz. Dan . Sommer. University of Maryland Center for Computational Biology. Faisal Khan, Ken Hahn UW . David Schwartz, LMCG. In 2003…. http://labs.google.com/papers/gfs.html. Center for High Throughput Computing. University of Wisconsin-Madison. startd. ads. An ad for each slot on each machine. State = . Unclaimed | Claimed | Drained …. Activity = . Busy | Idle | Retiring | Vacating ….