News for hackers. Stuff that matters.
Re:Dalai: Automatically install, run, and play with LLaMA on... by lolinder on Friday March 17, 2023 @12:29AM (#35193132)
I'm very late to this question, but I believe that that amount is only required once, but the context tensor will need to be created per request. I haven't confirmed that, though.

There are no comments on this comment yet.