News for hackers. Stuff that matters.
Re:Introducing ChatGPT Plus by a5withtrrs on Wednesday February 01, 2023 @10:51PM (#34621809)
Not being able to do simple math is a surprisingly huge bug IMO

Me: 5000 * 5000 * 5000 ChatGPT: The result of 5000 x 5000 x 5000 is 125,000,000,000,000. Me: 5000 * 5000 ChatGPT: The result of 5000 x 5000 is 25,000,000. Me: 5000 * 25000000 ChatGPT: The result of 25,000,000 x 5000 is 125,000,000,000.

Integrations with services like wolfram alpha would be nice as well (although shouldn't be necessary to solve basic multiplication)

Re:Introducing ChatGPT Plus by p-e-w on Wednesday February 01, 2023 @11:17PM (#34621992)
It's not a "bug" in the traditional sense, but a consequence of how language models work. Probability distributions over token chains are very powerful tools for generating human-like written text, but they perform poorly at symbolic inference. Humans have the same limitations, which is why math is a separate topic taught in schools that focuses not on knowledge but on algorithms. Understanding natural language syntax and semantics doesn't necessarily enable you to calculate.
Re:Introducing ChatGPT Plus by zemo on Thursday February 02, 2023 @12:07AM (#34622314)
if you ask it a question and it gives you a confident answer that's 100% wrong that's a terrible experience and a non-working product. "it's not a bug in the traditional sense" is technically correct but missing the point entirely.
Re:Introducing ChatGPT Plus by p-e-w on Thursday February 02, 2023 @12:28AM (#34622486)
ChatGPT is not a product, at least not for the purpose of answering arbitrary questions with a high degree of correctness. Nobody is claiming that ChatGPT is, or is supposed to be, the ultimate answer generating machine. If you are relying on the current generation of language models for that purpose you are making a huge mistake. They are a technology demonstration for what future AI products suitable for the mass market might look like, nothing less and nothing more.
Re:Introducing ChatGPT Plus by mshake2 on Thursday February 02, 2023 @12:24AM (#34622453)
Plenty of terrible experiences and non-working products are still very valuable to people. We're dealing with new magic here, so YMMV. I appreciate that you're trying to push to product forward, but if you have learned any background of how GPTs work, what you're asking for isn't really understood yet. The product might be too new for you.
Re:Introducing ChatGPT Plus by a5withtrrs on Sunday February 05, 2023 @05:11PM (#34670155)
Perhaps I should have added how I noticed in the first place. I gave it a block of code with a few nested loops and asked it how many times would it run. For a small number 5 x 5 x 5, it calculated correctly. But for 5000 x 5000 x 5000 it gave the wrong answer.

I'd like to see an integration into wolfram alpha or something. That would be amazing.

Re:Introducing ChatGPT Plus by Chico75 on Wednesday February 01, 2023 @10:52PM (#34621814)
and that's after the recent improvements
Re:Introducing ChatGPT Plus by city17 on Thursday February 02, 2023 @04:02AM (#34624010)
I noticed the announcement in the latest update that it was supposedly better at math, but the first simple calculations I gave it were all wrong. Not sure how it was improved at all.