Just hash and mask some number of bits, and map each index you get to some node. Faster, simpler, even enough distribution.
If your number of nodes is not a power of two, map multiple buckets to each node.
When adding nodes, and the # buckets is too low, split each bucket in two by adding one bit to the mask.
Consistent table construction means you only need the set of nodes to construct the take, keeping lookups entirely in core.
Maybe I should blog this, but it feels a bit like "Hey you cab implement modulo power of two with a bit mask! Isn't that so crazy?"
As long as the network is "fully connected" by knowing all other members, topology will not really matter.
If you use a Chord or pastry style skip list, you again have the exact same metrics as kademlia.
All of these redis structures are really just re-branded DHTs.
One nice thing about the hash ring is that it nicely rebalances when you add or remove nodes. There is no need split any buckets.
Just hash and mask some number of bits, and map each index you get to some node. Faster, simpler, even enough distribution.
If your number of nodes is not a power of two, map multiple buckets to each node.
When adding nodes, and the # buckets is too low, split each bucket in two by adding one bit to the mask.
Consistent table construction means you only need the set of nodes to construct the take, keeping lookups entirely in core.
Maybe I should blog this, but it feels a bit like "Hey you cab implement modulo power of two with a bit mask! Isn't that so crazy?"