Re:Big data is dead (2023)
by data-ottawa on Monday May 27, 2024 @05:43PM
(#40495030)
I wouldn't make a purchase of either without knowing a bit more about the lifecycle and requirements.
If you only needed this once, the BQ approach requires very little setup and many places already have a billing account. If this is recurring then you need to figure out what the ownership plan of the hard drive is (what's it connected to, who updates this computer, what happens when it goes down, etc.).
You can always save an intermediate data set partitioned and massaged into whatever format makes subsequent queries easy, but that's usually application-dependent, and so you want that control over how you actually store your intermediate results.