About cookies on this site Our websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising. For more information, please review your options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement. To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.
Publication
Middleware 2013
Conference paper
Dynamic datacenter resource provisioning for high-performance distributed stream processing with adaptive fault-tolerance
Abstract
A growing number of applications require continuous processing of high-throughput data streams, e.g., financial analysis, network traffic monitoring, or Big Data analytics in smart cities. Stream processing applications typically have explicit quality-of-service requirements; yet, due to the high time-variability of stream characteristics, it is inefficient and sometimes impossible to statically allocate all the resources needed to guarantee application SLAs. In this work, we present DARM, a novel middleware for adaptive replication that trades fault-tolerance for increased capacity during load spikes and provides guaranteed upper-bounds on information loss in case of failures. © 2013 ACM.