Load balancing memcached traffic using software defined networking

Anat Bremler-Barr*, David Hay, Idan Moyal, Liron Schiff

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

12 Scopus citations

Abstract

Memcached is an in-memory key-value distributed caching solution, commonly used by web servers for fast content delivery. Keys with their values are distributed between Mem-cached servers using a consistent hashing technique, resulting in an even distribution (of keys) among the servers. However, as small number of keys are significantly more popular than others (a.k.a., hot keys), even distribution of keys may cause a significantly different request load on the Memcached servers, which, in turn, causes substantial performance degradation. Previous solutions to this problem require complex application level solutions and extra servers. In this paper, we propose MBalancer-A simple L7 load balancing scheme for Memcached that can be seamlessly integrated into Memcached architectures running over Software-Defined Networks (SDN). In a nutshell, MBalancer runs as an SDN application and duplicates the hot keys to many (or all) Memcached servers. The SDN controller updates the SDN switches forwarding tables and uses SDN ready-made load balancing capabilities. Thus, no change is required to Memcached clients or servers. Our analysis shows that with minimal overhead for storing a few extra keys, the number of requests per server is close to balanced (assuming requests for keys follows a Zipf distribution). Moreover, we have implemented MBalancer on a hardware-based OpenFlow switch. As MBalancer offloads requests from bottleneck Memcached servers, our experiments show that it achieves significant throughput boost and latency reduction.

Original languageAmerican English
Title of host publication2017 IFIP Networking Conference, IFIP Networking 2017 and Workshops
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-9
Number of pages9
ISBN (Electronic)9783901882944
DOIs
StatePublished - 2 Jul 2017
Event2017 IFIP Networking Conference and Workshops, IFIP Networking 2017 - Stockholm, Sweden
Duration: 12 Jun 201716 Jun 2017

Publication series

Name2017 IFIP Networking Conference, IFIP Networking 2017 and Workshops
Volume2018-January

Conference

Conference2017 IFIP Networking Conference and Workshops, IFIP Networking 2017
Country/TerritorySweden
CityStockholm
Period12/06/1716/06/17

Bibliographical note

Publisher Copyright:
© 2017 IFIP.

Fingerprint

Dive into the research topics of 'Load balancing memcached traffic using software defined networking'. Together they form a unique fingerprint.

Cite this