News for hackers. Stuff that matters.
Re:The Leverage of LLMs for Individuals by nr2x on Wednesday May 10, 2023 @12:01PM (#35889285)
On top of no generally available API, GPT-4 in ChatGPT is really damn slow right now.

Unless you have a special deal (Microsoft) the only performant option is 3.5-turbo. In my experience for coding and text summarization it’s totally fine with a limited benefit from GPT-4, which is more impressive at higher order reasoning and planning.

Re:The Leverage of LLMs for Individuals by mrtranscendence on Wednesday May 10, 2023 @04:26PM (#35892996)
Interestingly (or not), Perplexity's GPT-4 chatbot is noticeably faster than ChatGPT-4 for me. I don't find its implementation quite as helpful, though, which is weird I think?