News for hackers. Stuff that matters.
Re:Cloudflare's AI Platform: an inference layer designed for... by bryden_cruz on Friday April 17, 2026 @03:38AM (#47803437)
Running a rack of 3090s in your garage to avoid provider lock-in/costs is the most Hacker News thing. Out of curiosity, what are you doing for uptime/failover? If you are running production traffic to that garage rack, does your app just degrade gracefully if your home internet drops, or do you have a cloud fallback?
Re:Cloudflare's AI Platform: an inference layer designed for... by mips_avatar on Friday April 17, 2026 @12:59PM (#47808022)
Yeah the model i'm running locally is just one of several models the app supports and it falls back to others if not available.