PPT-Galaxy and Condor: Challenges with harnessing widely-distributed resources

Condor Batch scheduler Similar to PBS SGE Manages a cluster of machines that can run Galaxy tasks Wellsuited to widelydistributed systems and sharing resources between groups James Thomson Lab. Access to resources of various machines is done explicitly by Remote logging into the appropriate remote machine Transferring data from remote machines to local machines via the File Transfer Protocol FTP mechanism Tightly Coupled Distributed System distributed, posted, or reproduced in any form by digital or mechanical means without prior written permission of the publisher. But if historicism is a faulty method that produces worthless results, High Throughput Computing . System. Sean Blackbourn. Teresia. . Djunaedi. Outline. What is Condor. ?. Fault Tolerance (MW & . DAGMan. ). Resource Discovery (Matchmaking). Job . Deployment (Universe). David Ríos. CSCI 6175. Fall 2011. Why are we going to spend 25 minutes on Condor?. Agenda. What is Condor?. Who can benefit from Condor?. Distributed Computer Concepts. Condor Design Philosophy. How Condor Works. G. . A Computation Management Agent for Multi-Institutional Grids. FATIH UNIVERSITY. Computer Engineering. Helton. MALAMBANE. Outline. INTRODUCTION. Large. -scale sharing of computational resources . Ketan Maheshwari. , Alex Rodriguez, David Kelly, Ravi . Madduri. , Justin Wozniak, Michael Wilde, Ian Foster. Argonne National Laboratory & University of Chicago. Overview. Introduce the Galaxy and Swift systems. Previously Covered. Some topics from the vanilla Condor operations talk apply to Condor-G. Configuration files. L. og files. Command-line tools. Job policy expressions. Where to get more help. HELD Status. Sam Hoover. shoover@clemson.edu. 1. Project Blackbird. Computing, Systems, and Operations. Clemson Computing and Information Technology. Project Blackbird. 3. Computing, Systems, and Operations. Clemson Computing and Information Technology. An Introduction. ICE 2011. The Condor Project . (Established ‘85). Distributed High Throughput Computing . research. performed by a team of ~35 faculty, full time staff and students.. Condor is a batch computing System . Campus. Condor Week . 2010. Preston . Smith. Purdue University. Outline. Campus Grids. Condor . Nests at Purdue. Central Clusters. Computing Labs. Departmental Resources. TeraGrid. Budget Realities in 2010. As identified by stakeholders. What about ancillaries?. What about nodal dispatch and settlement?. Resources must be paid nodal, 777 pays a resource load zone. Ancillaries. NPRR 777 was authored assuming that distributed resources that could respond as a reserve would be best suited for ERS. . Condor Week . May . 5. , 2011. Barton P. Miller. James A. . Kupsch. Computer Sciences Department. University of . Wisconsin. bart@cs.wisc.edu. Elisa . Heymann. Computer Architecture and. Operating Systems Department. -Style. Peter Couvares. Syracuse . University, LIGO . Scientific . Collaboration. Condor Week 2013. 1 May 2013. Who am I. ? What is LIGO?. Former Condor Team member (‘99-’08).. Now at Syracuse . Peter Couvares. Syracuse University. LIGO Scientific Collaboration. Who am I? What is LIGO?. Former Condor Team member (‘99-’08).. Now at Syracuse University focused on distributed computing problems for the LIGO Scientific Collaboration, and fostering a research computing community at SU more generally..