Re:
by zaidhaan on Sunday December 25, 2022 @02:45AM
(#34125246)
Pretty cool! Does anyone know how open-source alternatives like GPT-J compare to ChatGPT? I've heard that it's comparable to GPT-3, but nothing close to GPT-3.5. I'd much prefer using a tool that I know won't eventually be put behind a paywall.
[ Parent
| on HN ]
GPT-J feels much worse than GPT Davinci on the lack of instruct capability. My understanding is that it was not trained on instruction-completion data as much. It's great for text classification, summarization, and other tasks.
However, I also feel like it hallucinates/gives wrong outputs more. TBH i love what Eleuther is doing and GPT-J has its merits, but it feels not ready for primetime. I'd think of it as most similar to GPT Curie.
Re:
by mritchie712 on Sunday December 25, 2022 @08:17AM
(#34126983)
There's also CodeGen[0], but you'll likely get poorer results then any OpenAI product.