News for hackers. Stuff that matters.

A comment on Summary of the Amazon Kinesis Event in the Northern Virginia (US-East-1) Region.

Re:Summary of the Amazon Kinesis Event in the Northern Virgi... by tmk1108 on Saturday November 28, 2020 @12:53PM (#25239087)
How does the architecture of Kinesis compare to Kafka? If you scale up the number of Kafka brokers can you hit similar problem? Or does Kafka not rely on creating threads to connect to each other broker
[ Parent | on HN ]
Re:Summary of the Amazon Kinesis Event in the Northern Virgi... by aloknnikhil on Saturday November 28, 2020 @01:40PM (#25239485)
Kafka uses a thread pool for request processing. Both the brokers and the consumer clients use the same request processing loop.

This goes a bit more in-depth: https://jaceklaskowski.gitbooks.io/apache-kafka/content/kafk...

[ Parent | on HN ]