News for hackers. Stuff that matters.

A comment on Redis 6 RC1 is out today. Parent comment

Re:Redis 6 RC1 is out today by xfalcox on Thursday December 19, 2019 @02:19PM (#21838221)
One of our bottlenecks was really big keys (>1MB) being written and read too often and effectively stealing all the CPU time. That was fixed in the app by reducing the number of operations + compression. Threaded IO will give us a little more room.

Other use case involves LUA scripts that operate on 5 different keys, so cluster/proxy is out of question.

[ Parent | on HN ]
Re:Redis 6 RC1 is out today by rakoo on Thursday December 19, 2019 @02:56PM (#21838570)
Genuinely curious, why do you need such big keys ? Can't you hash them so you get nice short SHA-X strings for instance ?
[ Parent | on HN ]
Re:Redis 6 RC1 is out today by jdsully on Thursday December 19, 2019 @09:51PM (#21841373)
I run a fork called KeyDB with multithreading as well as a few optimizations directly around large values (redis does unnecessary copies).

It may work well for your use case. https://github.com/JohnSully/KeyDB

[ Parent | on HN ]
Re:Redis 6 RC1 is out today by antirez on Thursday December 19, 2019 @02:23PM (#21838263)
Oh I saw a wonderful (private) fork about this, sending very large keys using threads.
[ Parent | on HN ]