News for hackers. Stuff that matters.

A comment on Understanding the Limitations of Mathematical Reasoning in Large Language Models. Parent comment

Re:Understanding the Limitations of Mathematical Reasoning i... by ben_w on Saturday October 12, 2024 @04:48PM (#41822429)
He did say "sometimes Einstein is on the other end, and sometimes it's a drunken child. You have no idea when you pick up the phone which way its going to go.", so I think that's still a valid thing for him to complain about.

LLMs totally violate our expectations for computers, by being a bit forgetful and bad at maths.

[ Parent | on HN ]
Re:Understanding the Limitations of Mathematical Reasoning i... by steveBK123 on Saturday October 12, 2024 @06:58PM (#41823471)
Yes, to put a point on it -

How many dollars per month would someone be willing to spend for a chatbot that has a 3rd graders ability at math? Personally, $0 for me.

But what if it's a PHD Math degrees ability at math? Tons, in some applications it could be worth $100s or $1000s in an enterprise license setting.

But what if it's unpredictably, imperceptibly question to question, 95% PHD and 5% 3rd grader? Again, for me - $0. (not 95% of $1000s, but truly, $0)

[ Parent | on HN ]