Re:Show HN: s3-lambda – Lambda functions over S3 objects: ea...
by xtracto on Sunday February 12, 2017 @08:21PM
(#13632388)
This, we love S3. What we did is add a SQL tier for some of the data we are storing there in case we want to do some more structured operations.
[ Parent
| on HN ]
Re:Show HN: s3-lambda – Lambda functions over S3 objects: ea...
by hoodoof on Sunday February 12, 2017 @08:24PM
(#13632408)
Yes, but are you sure your database matches the underlying data store?
The real problem with building a metadata index outside is that you then have the synchronization validation - yuk.
Re:Show HN: s3-lambda – Lambda functions over S3 objects: ea...
by illumin8 on Monday February 13, 2017 @01:47AM
(#13633554)
You can always do a full scan of your S3 namespace every week or so and synchronize the index. This gives your consumers low latency access to the object store, as index lookups are extremely fast, it minimizes the cost of lookup events on S3.
Re:Show HN: s3-lambda – Lambda functions over S3 objects: ea...
by otterley on Monday February 13, 2017 @01:45PM
(#13637657)
This was just introduced last November: http://docs.aws.amazon.com/AmazonS3/latest/dev/storage-inven...
Re:Show HN: s3-lambda – Lambda functions over S3 objects: ea...
by hoodoof on Monday February 13, 2017 @03:36AM
(#13633929)
So my database is up to a week wrong? Errr.....