About cookies on this site Our websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising. For more information, please review your options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement. To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.
Publication
ICS 2014
Conference paper
Author retrospective for adaptive reduction parallelization techniques
Abstract
Modern applications are dynamic and input dependent and algorithm performance is input and environment sensitive. This potential mismatch between algorithmic choice and performance is exacerbated in the case of parallel programs because the penalty for less than optimal locality grows with the size of the machine. Reductions, e.g., map-reduce are one of the most important algorithms used in parallel codes are also input sensitive. This led us to develop an adaptive framework that used a statistical method to learn how to select the best algorithm for every execution instance. We applied it to parallel reduction algorithm selection. The importance of better reduction methods as well as adaptive selection methods has only increased since the time this paper was first published. Copyright