Re:Huggingchat Omni: Model router at inference for 115 open-...
by clmnt on Friday October 17, 2025 @07:17PM
(#45623285)
Hugging Face just released HuggingChat Omni, that selects the best model for every prompt automatically amongst 115 open-source models including gpt-oss, deepseek, qwen, kimi, smolLM, gemma, aya and many more already!
Omni uses a policy-based approach to model selection thanks to a model router called Arch-Router from Katanemo.
Omni uses a policy-based approach to model selection thanks to a model router called Arch-Router from Katanemo.