News for hackers. Stuff that matters.

A comment on Ultra-low-latency, batching and concurrent queue for IPC in Java. Parent comment

Re:Ultra-low-latency, batching and concurrent queue for IPC ... by capmorganbih on Wednesday November 27, 2024 @06:50PM (#42261011)
Kafka is good. The problem is we don’t have a dedicated person to manage it so sometimes we have kafka outages
[ Parent | on HN ]
Re:Ultra-low-latency, batching and concurrent queue for IPC ... by jojohohanon on Wednesday November 27, 2024 @11:50PM (#42262556)
There’s a whole conference in Vegas next week that want to sell you something.
[ Parent | on HN ]
Re:Ultra-low-latency, batching and concurrent queue for IPC ... by dikei on Thursday November 28, 2024 @02:42AM (#42263341)
So basically, you want to build a write-ahead-log before writing data to Kafka, and I think you're underestimating the effort to implement a WAL.

If you don't have a person that can manage Kafka, you almost definitely don't have the person to maintain a WAL.

[ Parent | on HN ]
Re:Ultra-low-latency, batching and concurrent queue for IPC ... by lizhenqi on Thursday November 28, 2024 @08:11AM (#42264994)
Just a suggestion, you can learn about automq (a message queue that has rewritten the storage layer based on Kafka), which has done a lot in automatic recovery and self-balancing, maybe it will help you. If you don't need it, you can ignore this comment.
[ Parent | on HN ]