News for hackers. Stuff that matters.

A comment on Fly.io Has GPUs Now.

Re:Fly.io Has GPUs Now by riquito on Tuesday February 13, 2024 @07:18PM (#39364714)
Is there any configuration to keep alive the machine for X seconds after a request has been served, instead of scaling down to zero immediately? I couldn't find it skimming the docs
[ Parent | on HN ]
Re:Fly.io Has GPUs Now by mrkurt on Tuesday February 13, 2024 @07:21PM (#39364734)
Machines are both dumber and more powerful than you'd think. Scaling down means just exit(0) if you have the right restart policy set. So you can implement any kind of keep-warm logic you want.
[ Parent | on HN ]
Re:Fly.io Has GPUs Now by Aeolun on Tuesday February 13, 2024 @08:03PM (#39365061)
Oh! I hadn’t thought if it like that. That makes sense.
[ Parent | on HN ]
Re:Fly.io Has GPUs Now by kylemclaren on Wednesday February 14, 2024 @08:56AM (#39369771)
you might also be looking for `kill_signal` and `kill_timeout`: https://fly.io/docs/reference/configuration/#runtime-options
[ Parent | on HN ]