Re:S3 trickery: using it as a scheduler
by scarface74 on Friday September 14, 2018 @08:16AM
(#17986619)
You can do the same with AWS...
- set a CloudWatch scheduled rule to schedule a lambda.
- or set a rule to send an sns, subscribe a queue to the sns topic and subscribe a lambda to the queue.
CloudWatch is cron based, which means you can't schedule a one time event.
Agree regarding sns, but in our case sns == s3
Re:S3 trickery: using it as a scheduler
by scarface74 on Friday September 14, 2018 @08:38AM
(#17986741)
AWS adds a year parameter to cron. You can specify the exact time.
Why use S3? S3 events aren’t guaranteed. SNS was specifically designed for this use case.
https://docs.aws.amazon.com/AmazonCloudWatch/latest/events/S...
Like Amazon's new SQS Lambda trigger you can then schedule a serverless function that's triggered by new items in the queue to have arbitrary scheduling of tasks.
Using their Python API it's pretty nice: