How to rehash and devide an exist redis into several redis instances? about twemproxy HOT 7 CLOSED

You have to write separate client app, that reads all the keys from existing 8 g redis server and write those keys to a cluster of backend redis server through twemproxy

let me know if this works

from twemproxy.

hi @highkay , There is a trick.
1] run new redis server
2] and run "slaveof original-ip original-port" on new node
3] run twemproxy
4] run "slaveof no one" on new node

But, this solution is somewhat dangerous.
because one of them fails, It can show old version data which it has.

from twemproxy.

@charsyam I like your idea

from twemproxy.

hi @charsyam If I am not misunderstand your idea, after 1,2 and 4, it made a full copy of my original node on the new node, while the two full copies are not rehashed at all!

from twemproxy.

@highkay hi. so I said it is a kind of trick.

first of all, twemproxy will hash your keys to distribute your queries.

so if you make a full copy of your original node.

It looks like rehashed two nodes.

It is because twemproxy will distribute your queries to 2 nodes.

from twemproxy.

hi @manjuraj I am sure the twemproxy would be convenience to run on a fresh redis cluster, but in my situation, it seems I would have to write my resharding programme. I wonder if there could be a solution like https://github.com/kni/redis-sharding-hs.

from twemproxy.

@charsyam First of all, I am sorry for maybe I am not clear my situation. Now we are not using twemproxy, only direct redis connections in our code. So the keys on the original node are not hashed at all. If I made the slave fresh new node fully copy the keys/data, it helped nothing.

from twemproxy.