News for hackers. Stuff that matters.

djboz

If the rest of your infra is on AWS(e.g., S3/RDS/Dynamo), why not just start with ECS? Egress fee's would seem to take a toll after a bit using Fly.io
Re:Executing Cron Scripts Reliably at Scale on Thursday February 01, 2024 @09:08AM (#39216043)
Really cool! For the Gearman workers, did you load jobs dynamically? Or, would you have to re-deploy for new jobs/updated jobs?
Re:Executing Cron Scripts Reliably at Scale on Thursday February 01, 2024 @09:03AM (#39215978)
Do you capture all of your job code in a single image and reference execution paths on container startup per job? Or, are you building an image per job?
Re:Executing Cron Scripts Reliably at Scale on Wednesday January 31, 2024 @06:50PM (#39211166)
What's the workflow for job registration look like? Does an engineer upload a single script/binary to some storage service(e.g., EFS/S3/whatever) or builds and uploads a container with script/binary, registers the rate in the conductor UI and then the job queue just pulls the script or container and runs it? Is registration through an IaC of sorts, or just through some UI/CLI?