If you think this is insanity I encourage you to look up the expected data to come out of the SKA. Even after several processing steps they expect several hundred PB/year (the raw data which is not being archived is several orders of magnitude more). That is only SKA-low I think for SKA-mid we are talking Exabyte/year. I recall that their chief scientist said once they are operational they will process more data than google and facebook combined.

Yeppers: https://en.wikipedia.org/wiki/Square_Kilometre_Array

In-page search for "data challenges". Pfew, that's a lot of data.