Heroku Kafka - Hackdot

Re:Heroku Kafka by mbseid on Tuesday April 26, 2016 @11:13PM (#11577606)

As a former user of Kafka, this is awesome and it would have been a huge help for our company if this was available then. I'm glad to hear that a company is offering Kafka as opposed to other propriety versions(AWS Kinesis etc).

One thing is odd though, there is no mention of disk space at all and only a configuration of retention time. One of Kafka's best features is the use of disk to store large amounts of messages, you are not RAM bound. Heroku seems to only allows you to set retention times? This could be awesome if they are giving you "unlimited" disk space, but could also be a beta oversight. Interested to see how this progresses.

[ Parent | on HN ]

Re:Heroku Kafka by uhoh-itsmaciek on Wednesday April 27, 2016 @03:27AM (#11578454)

Hi, I'm Maciek and I work on the Heroku Kafka team. You don't have to think about disk space--it's on us to make sure there's enough to satisfy the retention settings you configure. We're excited to provide another great open-source project as a managed service!

[ Parent | on HN ]

Re:Heroku Kafka by mbseid on Wednesday April 27, 2016 @04:41PM (#11584344)

Thanks for the update. That is awesome. Excited to see what people do with it.

[ Parent | on HN ]

Re:Heroku Kafka by ktamura on Wednesday April 27, 2016 @04:10AM (#11578601)

Don't forget that Heroku is the original multi-tenant shop. I wouldnt be surprised if a single Kafka instance stores multiple customers's messages and elastically scale as more customers/data is added.

[ Parent | on HN ]

Re:Heroku Kafka by sixwing on Wednesday April 27, 2016 @09:16AM (#11580086)

I'm Rand Fitzpatrick, and this is one of the products I work on at Heroku. None of our current Kafka offerings are multi-tenant.

[ Parent | on HN ]