News for hackers. Stuff that matters.

sauljp

Re:Show HN: I made a TUI for kafka (kaskade) on Tuesday July 16, 2024 @11:53AM (#40977672)
Working on it
Re:Show HN: I made a TUI for kafka (kaskade) on Monday July 15, 2024 @06:38PM (#40972083)
100%
Re:Show HN: I made a TUI for kafka (kaskade) on Monday July 15, 2024 @01:22PM (#40969756)
I do not think it is a shit arch. I think that is an arch for some problems, but people insist on using it for uses cases it was not built for.
Re:Show HN: I made a TUI for kafka (kaskade) on Monday July 15, 2024 @11:35AM (#40968804)
I guess both work :)
Re:Show HN: I made a TUI for kafka (kaskade) on Monday July 15, 2024 @11:34AM (#40968798)
100%
Re:Show HN: I made a TUI for kafka (kaskade) on Monday July 15, 2024 @11:33AM (#40968786)
Hey ddoolin, It's so nice to read this, yes! kaskade ignores the schema registry metadata for json and protobuf messages generated for schema registry, you do not need to provide url (only in case of using avro).

The only catch (in the protobuf case) is to generate the descriptors with protoc, but the good thing is generally we all have them, so maybe is not a big problem.

Re:Show HN: I made a TUI for kafka (kaskade) on Monday July 15, 2024 @11:28AM (#40968710)
Hi! I did not implemented something like that, but I can say this year textual has a great set of features and a nice community willing to help and share. I totally recommend textual.
Re:Show HN: I made a TUI for kafka (kaskade) on Sunday July 14, 2024 @10:40PM (#40964866)
Thanks!
Re:Show HN: I made a TUI for kafka (kaskade) on Sunday July 14, 2024 @10:33PM (#40964842)
Totally agree
Re:Show HN: I made a TUI for kafka (kaskade) on Sunday July 14, 2024 @08:15PM (#40964277)
about the first step: if you already have the .proto file you do not need to download it from schema registry
Re:Show HN: I made a TUI for kafka (kaskade) on Sunday July 14, 2024 @08:14PM (#40964271)
thanks! that is awesome
Re:Show HN: I made a TUI for kafka (kaskade) on Sunday July 14, 2024 @08:13PM (#40964264)
Hi! kaskade is more like AKHQ than Cruise control.

We use strimzi by default, so we deploy cruise control with kafka, and it takes care of rebalancing the data across the nodes. Also you can deploy it without strimzi.

Delete crap is more complicated, usually with kafka-delete-records (this is king of new I think). The problem is the offsets. By general rule you should not delete data from topics

Re:Show HN: I made a TUI for kafka (kaskade) on Sunday July 14, 2024 @08:00PM (#40964192)
Hi! it validates if the message was (or not) generated for schema registry, it checks if the message has the schema registry magic bytes (this bytes has the schema id). so, it deserializes messages with or without schema registry.

This is the drawback: you have to generate the descriptor first.

1) download the schema from schema registry: http :8081/schemas/ids/<my-id>/schema

2) generate the descriptor with the schema: protoc --include_imports --descriptor_set_out=my-descriptor.desc --proto_path=. my-schema.proto

3) use kaskade: kaskade consumer -b my-kafka:9092 -x auto.offset.reset=earliest -k string -v protobuf -t my-protobuf-topic -p descriptor=my-descriptor.desc -p value=mypackage.MyMessage

Re:Show HN: I made a TUI for kafka (kaskade) on Sunday July 14, 2024 @12:48PM (#40961911)
Install it:

brew install kaskade

pipx install kaskade