News for hackers. Stuff that matters.
Re:Locally hosted LLM use cases? by thensome on Tuesday June 27, 2023 @08:30PM (#36500684)
Yeah, it's still pretty slow and can't take large inputs very well. I'd say it takes 30sec to a minute to process a 200-300 word selection.

There are no comments on this comment yet.