News for hackers. Stuff that matters.
Re:Topicctl – an easier way to manage Kafka topics by rbranson on Tuesday August 25, 2020 @02:24PM (#24274368)
Segment employee here. Our Kafka runbook looks 100X cleaner after this tool was rolled out by Ben and folks. One of my favorite parts is how it makes dangerous things harder :)
Re:Topicctl – an easier way to manage Kafka topics by xref on Wednesday August 26, 2020 @01:33AM (#24279448)
Is there a reason you chose not to use ACLs? We did enable them, but it feels like it is causing more headaches than any security benefit it might provide...
Re:Topicctl – an easier way to manage Kafka topics by pryz on Wednesday August 26, 2020 @11:38AM (#24283435)
I guess we just haven't got the need to use ACL yet. This may be something we will look later on. We have been started to implement what's needed to leverage things like SASL in our instrumentation but we are not there yet (see https://github.com/segmentio/kafka-go).
Re:Topicctl – an easier way to manage Kafka topics by sumtechguy on Tuesday August 25, 2020 @03:12PM (#24274874)
nice! Just skimmed the docs. Does it handle ACL or stretched cluster yet? Planned?
Re:Topicctl – an easier way to manage Kafka topics by bhyolken on Tuesday August 25, 2020 @03:24PM (#24275023)
Not yet! But would be happy to look into those and/or get help adding them.
Re:Topicctl – an easier way to manage Kafka topics by dblooman on Tuesday August 25, 2020 @04:25PM (#24275695)
Did you look at using terraform for managing kafka topics?
Re:Topicctl – an easier way to manage Kafka topics by pryz on Tuesday August 25, 2020 @05:35PM (#24276426)
Segment employee here.

Yes, we looked at Terraform to manage our topics. We are big Terraform user to manage our infrastructure. We mostly didn't go that way because we didn't want to have to manage the Terraform state. We also wanted the tool to be extensible and writing custom TF providers can sometime be tricky.