News for hackers. Stuff that matters.
Re:Ask HN: What's your serverless stack for AI/LLM apps in p... by fazlerocks on Friday January 10, 2025 @04:09PM (#42660266)
Thanks for the detailed response!

I actually tried fly.io briefly with Next.js apps and the deployment experience was smooth. Really interesting to hear you're using it for AI workloads too.

For fly.io with AI workloads: Are you using their Machines or Apps? I'm particularly curious about how you're handling cold starts for LLM tasks, since that was one thing I loved about fly.io for regular Next.js deployments - the cold starts were minimal.

Re:Ask HN: What's your serverless stack for AI/LLM apps in p... by lunarcave on Sunday January 12, 2025 @04:51PM (#42677307)
I'm using the apps mostly. But I think you can use machines for more lower level use cases. IIRC, apps run machines.