Re:Show HN: Hyperparam: OSS Tools for Exploring Datasets Loc...
by dmosites on Thursday May 01, 2025 @10:27AM
(#43858149)
The iceberg reader sounds cool but how does it handle auth? Most iceberg tables are not publicly accessible.
[ Parent
| on HN ]
Re:Show HN: Hyperparam: OSS Tools for Exploring Datasets Loc...
by platypii on Thursday May 01, 2025 @10:36AM
(#43858249)
It does support using S3 presigned requests, but it's admittedly a little awkward to ask a server for a presigned request before every fetch. But does still have the benefit that you can have a small and light server just handing out signed requests, and then the user and their browser does the heavy lifting. This can save a lot on scaling out server costs.
That being said, I wish there was a better auth story. Open to suggestions if anyone has ideas!