Re:Ask HN: Do you get worst answers from OpenAI API compared...
by mikerg87 on Monday February 26, 2024 @02:18AM
(#39508426)
Yes. Attempts to match api with the chat interface have proved futile. The api never seems to behave in the same way as the chat interface.
[ Parent
| on HN ]
Re:Ask HN: Do you get worst answers from OpenAI API compared...
by RockCoach on Monday February 26, 2024 @04:06AM
(#39509092)
Have you tried tweaking parameters like temperature, top_p, or seed value when sending the API request?
Beyond that and due to the probabilistic nature of the LLM response I'm not sure how a reproducible "matching" between chat interface and API could be achieved.
I'm working primarily with the API through my own wrapper and I noticed that I tend to give less detailed instructions than when I'm using the OpenAI chat interface often resulting in a less accurate response.
Re:Ask HN: Do you get worst answers from OpenAI API compared...
by mikerg87 on Monday February 26, 2024 @03:40PM
(#39516518)
Thanks. I will. I must confess, I have not tried the top_p or seed value. I guess my naive belief was that the the defaults in the api matched the OOTB experience of the web interface. shame on me