Re:Small offline large language model – TinyChatEngine from MIT
by TotalCrackpot on Monday December 18, 2023 @11:11AM
(#38684405)
Yeah I imagine sequential inference would be slower. How long do you have to wait to load these weights on a personal PC? I have not tried using those systems so far.
[ Parent
| on HN ]
There are no comments on this comment yet.