Git Product home page Git Product logo

memc3's Introduction

MemC3

MemC3 is an in-memory key-value cache, derived from Memcached but improved with memory-efficient and concurrent data structures. MemC3 applies multi-reader concurrent cuckoo hashing as its key-value index and CLOCK-replacement algorithm as cache eviction policy. As a result, MemC3 scales better, runs faster, and uses less memory. For details about the algorithms, performance evaluation and citations, please refer to our paper in NSDI 2013. For a re-engineered fast, concurrent, stand-alone implementation of concurrent cuckoo hash table, please check our efficient/libcukoo repository.

Authors

MemC3 is developed by Bin Fan, David G. Andersen, and Michael Kaminsky. You can also email us at [email protected].

Requirements

$ sudo apt-get install libevent-dev

Building

$ autoreconf -fis
$ ./configure
$ make

If you want to generate optimized build (e.g., with -O2), run ./configure CFLAGS='-O2' instead of ./configure before make. Alternatively, if you want to create debug build (e.g., with -g -ggdb), use ./configure CFLAGS='-g -ggdb'

Benchmark

In our NSDI paper, memc3 is benchmared using workloads gerenated by Yahoo YCSB. Note that, YCSB is designed to benchmark the performance of cloud file systems, but too slow when used to benchmark memc3 or memcached directly. Therefore, we pre-generate workloads (using script bench/ycsb_workloads_gen.sh which reads settings in bench/ycsb_workloads_settings), and run clients to read these pre-generated traces before benchmarking.

memc3's People

Contributors

apc999 avatar binfan999 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

memc3's Issues

Failed to build bench/bench_client.c

Hello, I want to benchmark MemC3 , I have seen there is a executable app: bench/bench_client.c, it depends on memcached, so I install memcached as official web:

wget http://memcached.org/latest
tar -zxvf memcached-1.6.10.tar.gz
./configure && make && make test && make install

The memcached is install in /usr/local/include/memcached and executable app memcached is installed in /usr/local/bin, so I change #include <libmemcached/memcached.h> of bench.client.c and `bench/Makefile', but still many build errors, It seams the VERSION of memcached-1.6.10 does not match the MemC3 , so what's the correct VERSION of memcached you are using with MemC3 ? thank you in advance

Error logs:

bench_client.c:70:8: error: unknown type name ‘memcached_st’
 static memcached_st *memc_new()
        ^~~~~~~~~~~~
bench_client.c: In function ‘memc_new’:
bench_client.c:73:3: error: unknown type name ‘memcached_st’; did you mean ‘cache_t’?
   memcached_st *memc = NULL;
   ^~~~~~~~~~~~
   cache_t
bench_client.c:79:10: warning: implicit declaration of function ‘memcached’; did you mean ‘memc_new’? [-Wimplicit-function-declaration]

How to benchmark MemC3 using bench_client ?

Hello, I have build the memc3 successfully, follow the README, I have tested the bench_client using memcached. But I want to further benchmark memc3 , but the run_client.cpp can only benchmark memcached, could you please help to guide how to benchmark memc3 ?,thank you very much.

I have notice that the executable app memc3 creates a K-V server and listen the TCP port. This can be GET/SET/UPDATE K-V item interactively like memcached, I want to benchmark the latency and throughput using program rather than interactively

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.