News for hackers. Stuff that matters.

A comment on HopsFS: 100x Times Faster Than AWS S3. Parent comment

Re:HopsFS: 100x Times Faster Than AWS S3 by otterley on Saturday November 21, 2020 @05:08PM (#25173111)
Any particular reason you don't tag the objects instead? That's a significantly lighter-weight operation, since S3 doesn't have native renaming capability.
[ Parent | on HN ]
Re:HopsFS: 100x Times Faster Than AWS S3 by jamesblonde on Sunday November 22, 2020 @02:13AM (#25175631)
In HopsFS, you can also tag objects with arbitrary metadata (the xattr API), and the JSON objects you tag with are automatically (eventually consistent) replicated to Elastic search. So, you can search the FS namespace with free-text search on elastic. However, the lag is up to 100ms from the MySQL Cluster metadata. See the epipe paper in the blog post for details.
[ Parent | on HN ]
Re:HopsFS: 100x Times Faster Than AWS S3 by bfrydl on Saturday November 21, 2020 @05:30PM (#25173244)
You can't list objects by tag.
[ Parent | on HN ]
Re:HopsFS: 100x Times Faster Than AWS S3 by dragonwriter on Sunday November 22, 2020 @12:14AM (#25175110)
IIRC, you can, but it's bit elliptical: because IAM access policies can key off tags, you can adopt an IAM role that can only see the desired tags, and list objects.
[ Parent | on HN ]
Re:HopsFS: 100x Times Faster Than AWS S3 by otterley on Sunday November 22, 2020 @12:14AM (#25175115)
Ah hah - but see https://medium.com/zendesk-engineering/resurrecting-amazon-s...
[ Parent | on HN ]