News for hackers. Stuff that matters.
Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by stmw on Tuesday February 09, 2021 @03:47PM (#26082199)
Guess your were luckier? YMMV, I've found Kafka generally lives up to its terrible reputation -- and even when it doesn't, it's all somehow more difficult than its initial appeal. I certainly agree with others that inclusion of Kafka in an open-source package like this would discourage me from using it.
Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by TameAntelope on Tuesday February 09, 2021 @04:18PM (#26082484)
I don't think it was luck, I just continued to learn about the mistakes I was making, until I resolved the problems people typically bail upon encountering.
Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by pranay01 on Tuesday February 09, 2021 @03:58PM (#26082309)
Curious, is there an alternative to Kafka which would be more easier for you to adopt?
Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by vladsanchez on Tuesday February 09, 2021 @04:18PM (#26082487)
Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by pranay01 on Tuesday February 09, 2021 @04:45PM (#26082757)
We had checked out both these projects. Our view was that RedPanda was still an early project ( ~1.5K stars) and Pulsar was very similar to Kafka, and Kafka was more well known compared to Pulsar
Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by stmw on Tuesday February 09, 2021 @04:23PM (#26082549)
some options: - https://pulsar.apache.org/ - the many systems based on https://en.wikipedia.org/wiki/Advanced_Message_Queuing_Proto... - cloud-specific queues (SNS Kinesis et al)
Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by TameAntelope on Tuesday February 09, 2021 @04:32PM (#26082628)
Kafka does not fill the same use cases as these suggestions, this may be part of the trouble you were experiencing!

My use of Kafka was as a "system of record", and attaching connectors to create views into the data from there.

I could replay a Kafka topic into a MongoDB, run some analysis, and destroy the MongoDB instance.

Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by stmw on Tuesday February 09, 2021 @04:20PM (#26082505)
TameAntelope - sorry I should've phrased it differently, not "lucky" but more skillful as you say.
Re:Launch HN: SigNoz (YC W21) – Open-source alternative to D... by TameAntelope on Tuesday February 09, 2021 @04:36PM (#26082662)
I should say I had a team backing me up, and I lost many nights (and a handful of weekends) because Kafka didn't do what we expected.

The journey to feeling good with Kafka was difficult, but I was too stubborn to let us give up. :)