News for hackers. Stuff that matters.
Re:RasaGPT: First headless LLM chatbot built on top of Rasa,... by krishadi on Thursday May 11, 2023 @03:57AM (#35899151)
They are not all computationally expensive. The rate limiting step here is the LLM call itself over the API. So, async is definitely needed. The other aspects would be loading the template from filesystem. I would assume this could be something that's needs to be optimized in the application.

There are no comments on this comment yet.