Re:We Saved $500k per Year by Rolling Our Own "S3"
by coderintherye on Sunday October 26, 2025 @10:27PM
(#45716803)
I mean you can easily mount the S3 bucket to the local filesystem (e.g. using s3fs-fuse) and then use standard command line tools such as ls and grep.
[ Parent
| on HN ]
Re:We Saved $500k per Year by Rolling Our Own "S3"
by hallman76 on Sunday October 26, 2025 @10:48PM
(#45716926)
I inherited an S3 bucket where hundreds of thousands of files were written to the bucket root. Every filename was just a uuid. ls might work after waiting to page though to get every file. To grep you would need to download 5 TB.
Re:We Saved $500k per Year by Rolling Our Own "S3"
by codedokode on Sunday October 26, 2025 @10:36PM
(#45716861)
It's probably going to be dog slow. I dealt with HDDs where just iterating through all files and directories takes hours, and network storage is going to be even slower at this scale.