News for hackers. Stuff that matters.
Re:Ask HN: What's your current AI agentic setup? by yewenjie on Wednesday November 04, 2026 @11:13AM (#50367690)
What are you using to host GLM-Flash?
Re:Ask HN: What's your current AI agentic setup? by dgb23 on Wednesday November 04, 2026 @11:38AM (#50368111)
Didn't set it up myself so my info will be meagre, but I think it's litellm and a big enough nvidia card. We use it for development but also for internal applications (where smaller models might escalate a task to it when needed).

Obviously not feasible for (just) personal use, the model is too large for consumer hardware.