Randomized load balancing in scalable storage systems

Kun Fu; Roger Zimmermann

doi:10.1117/12.587266

17 January 2005 Randomized load balancing in scalable storage systems

Kun Fu, Roger Zimmermann

Proceedings Volume 5680, Multimedia Computing and Networking 2005; (2005) https://doi.org/10.1117/12.587266
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

Presently, IP-networked real-time streaming media storage has become increasingly common as an integral part of many applications. In recent years, a considerable amount of research has focused on the scalability issues in storage systems. Random placement of data blocks has been proven to be an effective approach to balance heterogeneous workload in a multi-disk environments. However, the main disadvantage of this technique is that statistical variations can still result in short term load imbalances in disk utilization, which in turn, cause large variances in latencies. In this paper, we propose a packet level randomization (PLR) technique to solve this challenge. We quantify the exact performance trade-off between our PLR approach and the traditional block level randomization (BLR) technique through analytical analysis. Our preliminary results show that the PLR technique outperforms the BLR approach and achieves much better load balancing in multi-disk storage systems.

Citation Download Citation

Kun Fu and Roger Zimmermann "Randomized load balancing in scalable storage systems", Proc. SPIE 5680, Multimedia Computing and Networking 2005, (17 January 2005); https://doi.org/10.1117/12.587266

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available