Launch HN: Sorcerer (YC S24) – Weather balloons that collect more data

Re:Launch HN: Sorcerer (YC S24) – Weather balloons that coll... by pkhodiyar on Tuesday August 20, 2024 @02:43AM (#41297428)

curious to know how you guys store and process the data and make meaningful inferences out of the data collected. Redshift? BigQuery? Datazip?

[ Parent | on HN ]

Re:Launch HN: Sorcerer (YC S24) – Weather balloons that coll... by avecchi-sorc on Tuesday August 20, 2024 @03:14AM (#41297601)

Internally yes we use a data warehouse to store the raw observations. We go through a similar process to traditional NWP to produce forecasts except with a few AI steps in between. Unfortunately, the standard currently is to store these as large multi-dimensional data files like grib2/netCDF/zarr.

In case you’re curious, here’s where NOAA stores all their GFS related forecasts: https://registry.opendata.aws/noaa-gfs-bdp-pds/

[ Parent | on HN ]