Portal de Periódicos da CAPES

Optimizing Locality-Aware Memory Management of Key-Value Caches

2016; Institute of Electrical and Electronics Engineers; Volume: 66; Issue: 5 Linguagem: Inglês

10.1109/tc.2016.2618920

2326-3814

Xiameng Hu, Xiaolin Wang, Lan Hua Zhou, Yingwei Luo, Chen Ding, Song Jiang, Zhenlin Wang,

Cloud Computing and Resource Management

The in-memory cache system is a performance-critical layer in today's web server architectures. Memcached is one of the most effective, representative, and prevalent among such systems. An important problem is on its memory allocation. The default design does not make the best use of the memory. It is unable to adapt when the demand changes, a problem known as slab calcification. This paper introduces locality-aware memory allocation (LAMA), which addresses the problem by first analyzing the locality of Memcached's requests and then reassigning slabs to minimize the miss ratio or the average response time. By evaluating LAMA using various industry and academic workloads, the paper shows that LAMA outperforms existing techniques in the steady-state performance, the speed of convergence, and the ability to adapt to request pattern changes, and overcome slab calcification. The new solution is close to optimal, achieving over 98 percent of the theoretical potential. Furthermore, LAMA can also be adopted in resource partitioning to guarantee quality-of-service (QoS).