News for hackers. Stuff that matters.
Re:The Coming of Local LLMs by cahoot_bird on Tuesday April 11, 2023 @12:31PM (#35527492)
I tried Vicuna on my laptop's CPU. I really wasn't impressed, it seemed terrible in comparison to the web version with a GPU and could only answer basic questions.

But I don't know how optimized all the parameters were, i was just using default everything from the nearest tutorial I could find.

There are no comments on this comment yet.