News for hackers. Stuff that matters.
Re:Big data is dead (2023) by crowcroft on Monday May 27, 2024 @10:53AM (#40491291)
I worked in a large company that had a remote desktop instance with 256gb ram running a PG instance that analysts would log in to to do analysis. I used to think it was a joke of setup for such a large company.

I later moved to a company with a fairly sophisticated setup with Databricks. While Databricks offered some QoL improvements, it didn't magically make all my queries run quickly, and it didn't allow me anything that I couldn't have done on the remote desktop setup.

There are no comments on this comment yet.