Analysis and control of correlated Web server queues

Abstract

This paper demonstrates the existence of considerable dependencies between Web server arrival and service times, as well as strong dependencies within the arrival process. We derive a heavy-traffic stochastic-process limit for Web server performance, under various control policies, that captures these forms of correlations. This includes an analysis of control policies that provide near-optimal expected response times while also maintaining good response time variance properties.