Re:Processing billions of events in real time
by pram on Monday November 15, 2021 @11:57PM
(#29237025)
It can, but this depends on the volume and size of the topic messages. The broker and consumer will need a LOT more memory. I did this at a previous job and the GC on the broker started getting very shitty and performance was crap. Consumers were constantly getting OOM and needed bigger containers, etc. It was a bad idea and we just moved the stuff to S3.
[ Parent
| on HN ]
There are no comments on this comment yet.