Re:How Fast can A Single Instance of Redis be?
by caymanjim on Tuesday June 18, 2019 @04:35PM
(#20218098)
Anecdotally, my experience running Redis servers on AWS (both standalone EC2 instances and ElastiCache dedicated Redis instances) is that network latency is likely to become a barrier before anything else. We struggled with the same performance problems on both small-footprint small-payload Redis DBs and on large ones, and paying for the next tier of network connectivity (between our applications on EC2 and our Redis servers on EC2/ElastiCache) did the most to alleviate delays.
[ Parent
| on HN ]
Re:How Fast can A Single Instance of Redis be?
by KenanSulayman on Tuesday June 18, 2019 @04:55PM
(#20218299)
This is very accurate. Seeing variations in GET / SET operations with ElastiCache up to 10000μs, which is way longer than the actual execution speed. After moving complex operations to transactions & even Lua scripts, performance is fairly acceptable again.
I assume the AWS network is pretty noisy.
Re:How Fast can A Single Instance of Redis be?
by marknadal on Tuesday June 18, 2019 @10:32PM
(#20220357)
Yeah, this is true in my case as well.
Years ago I built a layer on top of Redis that could also run in the browser, so I could cache data there. Even pull from other browsers with WebRTC, and fallback to server only when needed.
Over time, I eventually made the Redis component a module, so it could be swapped out with other systems. It has always proved to be the fastest, except for an LMDB adapter someone in the community wrote ( https://github.com/notabugio/gun-lmdb ).
Re:How Fast can A Single Instance of Redis be?
by maxpert on Wednesday June 19, 2019 @08:31AM
(#20222670)
You are facing same problems that I’ve experienced and I developed different techniques to get around these network latencies. In our case most of the payloads were large fragments of compiled JSON. So we benchmarked and found LZ4 to be lightweight compression cutting down on network payload and cache size at same time. Shameless plug https://youtu.be/QkUz2_kRV9g I discussed them at RedisConf.