Distributed and adaptive execution of Condor DAGMan workflows

Abstract

This paper presents a decentralized execution approach to large-scale workflows on multiple resource domains. This approach includes a low overhead, decentralized runtime adaptation mechanism that improves the performance of the system. A prototype implementation based on standard Condor DAGMan workflow execution engine, does not require any modifications to Condor or its underlying system.