News for hackers. Stuff that matters.
Re:Finding Kafka’s throughput limit in Dropbox infrastructure by Rafuino on Friday February 01, 2019 @12:56PM (#19056510)
60 MB/s per broker at what latency though? Does latency even factor into the performance consideration?
Re:Finding Kafka’s throughput limit in Dropbox infrastructure by halbritt on Friday February 01, 2019 @01:23PM (#19056841)
For some use cases, it absolutely does. I can't remember the exact use case, but a friend of mine is adopting kafka with an end-to-end latency goal of 100ms. Absolutely requires SSDs and for the producers and consumers to be colocated, but is otherwise not that difficult to achieve.