News for hackers. Stuff that matters.
Re:GPT4All releases one click install for Mac,win64,Linux wi... by jb510 on Tuesday April 18, 2023 @01:07AM (#35610169)
It was based on GPT 3.5 Turbo, but it just changed to a new model GPT4All-J which is improved from 3.5 turbo, but still small enough to run locally. It’s still it’s a small model compared to GPT4 so can’t imagine to competes head to head with that best.
Re:GPT4All releases one click install for Mac,win64,Linux wi... by bheadmaster on Tuesday April 18, 2023 @01:14AM (#35610215)
I've tried it, I remember it being more akin to cleverbot than GPT. One thing I love about GPT - context recognition - seems somewhat broken, having model reply with random nonsense unrelated to my prompt each time.

I really hope it manages to catch up eventually. In terms of privacy, a local LLM is lightyears ahead of a SaaSS LLM controlled by Microsoft.

Re:GPT4All releases one click install for Mac,win64,Linux wi... by manyoso on Tuesday April 18, 2023 @02:02AM (#35610465)
There is a big update released today… maybe give it another go?
Re:GPT4All releases one click install for Mac,win64,Linux wi... by bheadmaster on Tuesday April 18, 2023 @04:48AM (#35611515)
What exactly was updated, the model weights, the code, or both? Can I find release notes anywhere?

I am a little wary of the opaque installer binary that requires root permission...

Re:GPT4All releases one click install for Mac,win64,Linux wi... by manyoso on Tuesday April 18, 2023 @06:08AM (#35612024)
All of the above and the root permission will be fixed jn future release if yuh want to wait
Re:GPT4All releases one click install for Mac,win64,Linux wi... by sbierwagen on Tuesday April 18, 2023 @01:45AM (#35610387)
It's fine tuned on ChatGPT answers, but the actual underlying model is GPT-J, a 6 billion parameter model. Roughly one twentieth the size of GPT-3, and it's capabilities are about what you'd expect from that number. I installed it, asked a few dozen questions, then uninstalled when I got garbled nonsense in response. (Not just wrong answers, but incoherent noise, repeating chunks of training prompts back to me unrelated to the question, random python code, etc)
Re:GPT4All releases one click install for Mac,win64,Linux wi... by manyoso on Tuesday April 18, 2023 @02:02AM (#35610461)
Did you try the new version released today? The initial version had a bad bug that is now fixed with drastically better performance. Many users are reporting some quite high quality responses on discord. Check it out! Link on the homepage…
Re:GPT4All releases one click install for Mac,win64,Linux wi... by Zetobal on Tuesday April 18, 2023 @03:05AM (#35610862)
For smaller projects like this the discord servers are usually nothing more than a enthusiastic group that is gaslighting itself.