News for hackers. Stuff that matters.
Re:Small offline large language model – TinyChatEngine from MIT by TotalCrackpot on Monday December 18, 2023 @11:11AM (#38684405)
Yeah I imagine sequential inference would be slower. How long do you have to wait to load these weights on a personal PC? I have not tried using those systems so far.

There are no comments on this comment yet.