For Want of a JOIN

Re:For Want of a JOIN by lmm on Thursday December 22, 2022 @06:52PM (#34100591)

I find the opposite; SQL databases work a lot like Kafka underneath, but hide it from you, burning all your CPU to generate this illusion of a globally consistent state of the world that you don't actually want or need and doing everything they can to avoid ever showing you what they're actually doing.

[ Parent | on HN ]

Re:For Want of a JOIN by ttfkam on Thursday December 22, 2022 @10:51PM (#34102171)

Hold up. I need some clarification here. SQL databases are opaque with regard to resource usage but Kafka is completely transparent in this regard? That is your personal experience and assertion?

[ Parent | on HN ]

Re:For Want of a JOIN by lmm on Thursday December 22, 2022 @11:04PM (#34102229)

Yes. I once saw an outage caused by an SQL database server collapsing because of a query that had been issued 23 days earlier. I saw another one gradually get slower and slower over a period of weeks because a data scientist had left a command prompt open and forgotten about it. Kafka brokers are a lot more consistent and predictable IME.

[ Parent | on HN ]