News for hackers. Stuff that matters.
Re: by doctorpangloss on Saturday October 19, 2024 @12:01PM (#41888585)
Yesterday my company changed a single line to switch our application’s LLM backend API from Claude to ChatGPT, because Claude started adding stuff its answers in QA style prompts that it wasn’t before, at least since August 1st.

I wish I could pay for a guarantee of performance, really quantization, which seems so simple but because it can 2-4x decrease their costs, LLM API providers keep doing quantizing without telling anyone. It’s a longer journey: slto be an enterprise API. Which by the way, is a terrible business to be in.

There are no comments on this comment yet.