News for hackers. Stuff that matters.
Re: by furyofantares on Thursday April 06, 2023 @05:21PM (#35474650)
Very cool.

I'd love it if it gave me more info about the differences between some of the available models. I've been using GPT4 exclusively from the web interface; I don't know why I might select GPT4 vs GPT4-0314. I believe I do know why I want to use 32k, but others might not.

Basically, I'd want an explanation as to how these differ from what's available in the ChatGPT web-app.

The default temperature is 0.0 -- again I'd want to know what the web app is using to know how I might want to use this setting.

edit: I guess an answer is my API key is only valid for 3.5 anyway. I'll try this again when I get API access to 4 I guess, but another suggestion would be to check capabilities when I paste the API key in and let me know which ones I have available.

Re: by fliife on Thursday April 06, 2023 @05:46PM (#35474973)
The UI sure needs a bit of work. I'll try to add more information about the different models.

As for the default temperature, 0.0 is actually a bug ! I'll definitely fix that in the next release. The default intended value is 1.0. The API reference [1] describes what the temperature parameter does in more detail.

While doing some testing, I also noticed that the app disables streamed responses by default. Make sure to check the appropriate checkbox in the settings to get token-per-token answers !

[1] https://platform.openai.com/docs/api-reference/chat/create

Re: by Terretta on Thursday April 06, 2023 @10:48PM (#35477415)
'-0314' is a snapshot date, won't change, and will be retired in 3 mos:

https://platform.openai.com/docs/models/gpt-4