News for hackers. Stuff that matters.
Re:Ask HN: Any pragmatic guides to building large data pipel... by markus_zhang on Monday November 01, 2021 @09:31PM (#29075742)
I believe we need more details. Even though you may not be able to disclose the n*k sources, at least you can estimate the volume per min/hour/day as well as the analysis requirements (real-time or delayed)? Also what kind of "processing" should we expect? There is a lot of difference between a simple transform against some data science algos.

There are no comments on this comment yet.