Amazon to invest another $4B in Anthropic, OpenAI's biggest rival

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by sbuttgereit on Friday November 22, 2024 @01:21PM (#42216136)

Hmmm... I wonder if this is why some of the results I've gotten over the past few days have been pretty bad. It's easy to dismiss poor results on LLM quality variance from prompt to prompt vs. something like this where the quality is actively degraded without notification. I can't say this is in fact what I'm experience, but it was noticeable enough I'm going to check.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by jmathai on Friday November 22, 2024 @01:53PM (#42216408)

Never occurred to me that the response changes based on load. I’ve definitely noticed it seems smarter at times. Makes evaluating results nearly impossible.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by kridsdale1 on Friday November 22, 2024 @03:35PM (#42217180)

My human responses degrade when I’m heavily loaded and low on resources, too.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by TeMPOraL on Friday November 22, 2024 @03:47PM (#42217253)

Unrelated. Inference doesn't run in sync with the wall clock; it takes whatever it takes. The issue is more like telling a room of support workers they are free to half-ass the work if there's too many calls, so they don't reject any until even half-assing doesn't lighten the load enough.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by Seattle3503 on Friday November 22, 2024 @02:58PM (#42216893)

This is one reason closed models suck. You can't tell if the bad responses are due to something you are doing, or if the company you are paying to generate the responses is cutting corners and looking for efficiencies, eg by reducing the number of bits. It is a black box.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by mirsadm on Friday November 22, 2024 @03:20PM (#42217078)

To be fair even if you did know it would still behave the same way.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by TeMPOraL on Friday November 22, 2024 @03:30PM (#42217159)

Still, knowing is what makes the difference between gaslighting and merely subpar/inconsistent service.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by baxtr on Friday November 22, 2024 @02:12PM (#42216571)

Recently I started wondering about the quality of ChatGPT. A couple of instances I was like: "hmm, I’m not impressed at all by this answer, I better google it myself!"

Maybe it’s the same effect over there as well.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by dave84 on Friday November 22, 2024 @02:53PM (#42216857)

Recently I asked 4o to ‘try again’ when it failed to respond fully, it started telling me about some song called Try Again. It seems to lose context a lot in the conversations now.

[ Parent | on HN ]

Re:Amazon to invest another $4B in Anthropic, OpenAI's bigge... by 55555 on Friday November 22, 2024 @01:26PM (#42216177)

Same experience here.

[ Parent | on HN ]