News for hackers. Stuff that matters.
Re:ChatGPT Plugins by pbronez on Friday March 24, 2023 @10:24AM (#35289442)
Agree that Alpaca is Important. I got the smallest one running on a pathetic notebook… 2 cores, 8GB RAM. It was slow. It was sloppy. But it worked. Getting these things running on GPU/NPU will be very compelling, especially if we don’t hit a wall on compression. I think a sweet spot exists where consumer clients are powerful enough and models are small enough to deliver value and privacy.

There are no comments on this comment yet.