Re:In S3 simplicity is table stakes
by user9999999999 on Friday March 14, 2025 @10:47AM
(#43363129)
if only metadata could be queried without processing a csv output file first, imagine storing thumbnails in there even! copied objects had actual events, not something you have to dig cloudtrail for, you could get last update time from a bucket to make caching easier
[ Parent
| on HN ]
I think you are a bit out of date, when S3 Tables launched they made the Metadata available using this technology. So you can query it like an Apache Iceberg table.
https://aws.amazon.com/blogs/aws/introducing-queryable-objec...
Are you talking about getting metadata from many objects in the bucket simultaneously? You might be interested in S3 Metadata https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingM....
Re:In S3 simplicity is table stakes
by user9999999999 on Friday March 14, 2025 @01:09PM
(#43364687)
whoops. I was wrong! you can store base64 encoded metadata in the object then run a HEAD request to get it, but its limited to 2kb.
also, you ~can~ query the metadata, but its latency is more suited to batch processing and not lambdas