Re:Building a distributed log using S3 (under 150 lines of Go)
by rad_gruchalski on Sunday December 01, 2024 @12:38PM
(#42289559)
Kafka does batch reading anyway. Have a look at the reader, it’s a loop with read and read timeout. Usually a 100ms per single loop iteration.
Downside is the 250ms latency. But then again, a fair amount of workloads can deal with 250ms of latency.