News for hackers. Stuff that matters.
Re:Google Picks Diane Greene to Expand Its Cloud Business by boundlessdreamz on Thursday November 19, 2015 @10:57PM (#10599473)
I'm not familiar with Kafka

1. Can you direct the consumer to a point in stream? (ideally time based i.e messages from 16 Nov UTC)

2. Can old events be auto removed defined by rules?

Re:Google Picks Diane Greene to Expand Its Cloud Business by herriojr on Friday November 20, 2015 @01:53AM (#10600015)
I haven't played with kafka in a while, but basically,

1. each group id represents a point in the stream that a consumer is processing off of. You could technically have multiple processes consuming off of a single group id.

2. there was a configuration on time to keep things there as well as space if I remember correctly, but basically, there has to be. There's a pretty hard limit on what all you can store on disk.

edit: changed consumer id to group id. If you want more info, feel free to ping me about the ecosystem