Re:RasaGPT: First headless LLM chatbot built on top of Rasa,...
by sroussey on Monday May 08, 2023 @12:31PM
(#35863602)
You can use MLC with different (bigger) models, right?
[ Parent
| on HN ]
Re:RasaGPT: First headless LLM chatbot built on top of Rasa,...
by execveat on Monday May 08, 2023 @12:56PM
(#35863988)
You can't right now. Devs are working on instructions for porting other models, but they're not ready yet. The point of MLC is that it supports pretty much all GPU backends out there (including Intel and Mac). The bundled model is just a proof of concept.