News for hackers. Stuff that matters.
Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by LASR on Tuesday March 21, 2023 @05:26AM (#35244097)
We have a whole team of folks just watching for these to come out and then go evaluate them.

Short answer: none of them do as well as the OG Davinci-003. Not even close. Even the 3.5 Turbo models from OpenAI don’t do as well.

We throw some sophisticated prompts at them to attempt chain of thought reasoning.

Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by inciampati on Tuesday March 21, 2023 @06:14AM (#35244376)
Do you have a citation for that?
Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by sirlunchalot on Tuesday March 21, 2023 @10:53AM (#35247055)
would be interested in that as well
Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by dotancohen on Tuesday March 21, 2023 @06:22AM (#35244422)
Could you expand on this a bit more? What types of prompts? What are your evaluation criteria?

This actually sounds fascinating. Not unlike birdwatching! ))

Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by dr_dshiv on Tuesday March 21, 2023 @07:34AM (#35244860)
We need open benchmarks, clearly. Know any projects in that space?
Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by joenot443 on Tuesday March 21, 2023 @07:46AM (#35244940)
That’s interesting - what about 4?
Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by simonw on Tuesday March 21, 2023 @09:07AM (#35245577)
What kind of things have you seen davinci-003 do better than 3.5 turbo?
Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by WinstonSmith84 on Tuesday March 21, 2023 @09:12AM (#35245631)
That's quite a confusing comment. `davinci-003` is from OpenAI, whereas ChatGPT is some sort of variants more "optimized" for chatting. Said differently, GPT3 or 3.5 is a customized version of `davinci-003`, made for chatting. Please don't ask me on the details, I don't know, but `davinci-003` is not an alternative to ChatGPT
Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by wahnfrieden on Tuesday March 21, 2023 @10:27AM (#35246662)
It is an alternative. It’s just more expensive.
Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by sebzim4500 on Tuesday March 21, 2023 @10:53AM (#35247062)
>but `davinci-003` is not an alternative to ChatGPT

Why makes you believe that? In my testing davinci does better than gpt-3.5-turbo for most tasks.

Re:Awesome-totally-open-ChatGPT: A list of open alternatives... by WinstonSmith84 on Tuesday March 21, 2023 @03:19PM (#35251160)
I think people, and this article, is about suggesting alternatives (competitors) to ChatGPT. `davinci` is obviously not an alternative, ChatGPT is `davinci` made for chatting. As to whether davinci produces better responses than ChatGPT ... maybe? but that's a different question