News for hackers. Stuff that matters.
Re:Ask HN: Do you get worst answers from OpenAI API compared... by mikerg87 on Monday February 26, 2024 @02:18AM (#39508426)
Yes. Attempts to match api with the chat interface have proved futile. The api never seems to behave in the same way as the chat interface.
Re:Ask HN: Do you get worst answers from OpenAI API compared... by RockCoach on Monday February 26, 2024 @04:06AM (#39509092)
Have you tried tweaking parameters like temperature, top_p, or seed value when sending the API request?

Beyond that and due to the probabilistic nature of the LLM response I'm not sure how a reproducible "matching" between chat interface and API could be achieved.

I'm working primarily with the API through my own wrapper and I noticed that I tend to give less detailed instructions than when I'm using the OpenAI chat interface often resulting in a less accurate response.

Re:Ask HN: Do you get worst answers from OpenAI API compared... by mikerg87 on Monday February 26, 2024 @03:40PM (#39516518)
Thanks. I will. I must confess, I have not tried the top_p or seed value. I guess my naive belief was that the the defaults in the api matched the OOTB experience of the web interface. shame on me
Re:Ask HN: Do you get worst answers from OpenAI API compared... by uma08 on Monday February 26, 2024 @02:09AM (#39508374)
yes, I've experienced this via their api. Although the GPT-4 model is a tad bit better in its responses compared to the turbo model
Re:Ask HN: Do you get worst answers from OpenAI API compared... by JojoFatsani on Monday February 26, 2024 @06:57AM (#39510270)
It works pretty well for me. Is MacGPT. Maybe mess with your prompt.