Re:Ask HN: What's your current AI agentic setup?
by yewenjie on Wednesday November 04, 2026 @11:13AM
(#50367690)
What are you using to host GLM-Flash?
[ Parent
| on HN ]
Re:Ask HN: What's your current AI agentic setup?
by dgb23 on Wednesday November 04, 2026 @11:38AM
(#50368111)
Didn't set it up myself so my info will be meagre, but I think it's litellm and a big enough nvidia card. We use it for development but also for internal applications (where smaller models might escalate a task to it when needed).
Obviously not feasible for (just) personal use, the model is too large for consumer hardware.