Re:The Coming of Local LLMs
by cahoot_bird on Tuesday April 11, 2023 @12:31PM
(#35527492)
I tried Vicuna on my laptop's CPU. I really wasn't impressed, it seemed terrible in comparison to the web version with a GPU and could only answer basic questions.
But I don't know how optimized all the parameters were, i was just using default everything from the nearest tutorial I could find.
But I don't know how optimized all the parameters were, i was just using default everything from the nearest tutorial I could find.