News for hackers. Stuff that matters.
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by supermatt on Tuesday September 19, 2023 @04:57PM (#37576476)
Thats kind of like saying dont use any software libraries because they all use the standard lib indirectly so you may as well just use that?

Its just an abstraction layer to make things less effort.

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by eddythompson80 on Tuesday September 19, 2023 @05:03PM (#37576600)
yeah, don't wrap all calls to a standard lib in another homegrown or non-standard single-digit user lib that makes changes in all sort of subtle ways. There are plenty of C++ projects that make their own or wrap stdlib and they are always a big wtf.

It's one thing to have an abstraction for kafka in your code, it's another to wrap the client in a smart client that reimplements something like rabbitmq, and much worse a smart service.

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by supermatt on Tuesday September 19, 2023 @05:05PM (#37576625)
> don't wrap all calls to a standard lib

Im not saying to expose the same primitives - what would be the point in that? I am saying that EVERY lib you use will be using the standard lib or some abstraction of it to perform its own utility.

> It's one thing to have an abstraction for kafka in your code, it's another to wrap the client in a smart client, and much worse a smart service.

That abstraction is exactly what i am talking about. Why write 50 lines of boilerplate multiple times throughout your code when you can wrap that up in a single function call and expose THAT as your client. You know thats exactly what you will end up doing on any non-trivial project. Or you could use a lib that already does that - such as the "official" kafka streams lib.

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by hamandcheese on Tuesday September 19, 2023 @07:21PM (#37578439)
> Thats kind of like saying dont use any software libraries because they all use the standard lib indirectly so you may as well just use that?

This is decent advice, IMO. The cost of dependency management is often vastly understated.

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by snoman on Wednesday September 20, 2023 @04:16AM (#37581733)
That’s Not Invented Here syndrome, and it’s decidedly bad advice.

The cost of dependency management may be understated but it’s always less than the cost of reimplementing everything found in established libraries.

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by hamandcheese on Thursday September 21, 2023 @05:50PM (#37604900)
Being judicious in which dependencies you take on is not the same as Not Invented Here syndrome. Code is usually a liability, not an asset.
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by 59nadir on Sunday September 24, 2023 @04:07AM (#37631075)
One HTTP connection per message (if this is what the original poster meant) is probably a bad idea whether you implement it yourself or not.

Also, let's be honest: The phalanx of developers that violently argue for importing everything and never implementing anything yourselves is way bigger than people who argue for the opposite; I don't think we need to worry about the latter making things worse as much as the former.

We've seen what the world turns into in both scenarios, I would argue, and at least with the first one we got software that ran decently and developers who knew how to actually do things. We have overall much safer languages now so their home grown solutions won't have the same safety issues that they've historically had.

With the importer crowd we've gotten software that feels like molasses and an industry full of people who know only the surface of everything and more importantly become tied to frameworks and specific APIs because they never actually go beyond any surface APIs.

As with most tradeoffs in software there is a good middle-ground, but we won't ever get there if we don't have people who argue for making things yourselves.

Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by debadyutirc on Tuesday September 26, 2023 @02:41PM (#37663907)
Who has the time to count the cost. Just keep shipping and worry about the costs later is the reality in a large portion of the tech ecosystem.
Re:RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) by zaphirplane on Tuesday September 19, 2023 @08:16PM (#37578862)
mediocre Libraries sink to the bottom over time. Home grown libraries have a different quality and don’t sink easily. This is definitely YMMV for different teams

I can imagine home grown libraries having inconsistent api with wild and wonderful assumptions and beware the edge cases