The real question is if ChatGPT is worse on math and better elsewhere, or just worse overall. That is still unknown
> Can you give me a query in Wolfram language for the first 25 prime numbers?
> Prime[Range[25]]
> What about one for the limit of 2/x as x tends towards infinity?
> Limit[2/x, x -> Infinity]
Edited out most of the chatter from it for clarity.
Two months ago they were telling me ChatGPT is coming for everyone - programmers, accountants, technical writers, lawyers, etc.
Now we're slowly back to "so here's the thing about LLMs"...
You weren't paying attention.
I was paying attention and it’s why I refuse to use LLMs for math, but I’m being told by people inside the castle to do so. So it is not so black and white in the messaging dept.
Literally nothing about this proposal makes sense. The loss of precision/accuracy (the LLM is akin to applying one-way lossy and non-deterministic encoding to the source data), the costs involved, efficiency, etc.
All just to tell everybody they managed to shove LLMs somewhere into the backend.
There's a certain type of person who sees a new thing, and goes "this will change everything". For every new thing. Very occasionally, they're right, by accident. In general, it's safest to be very, very sceptical.
Person A offers a reason why we may want to be slightly more skeptical than normal about this information. Person B suggests we can pretty easily look past that. Person C (you) injects themselves in the conversation simply to say that they can't add anything to the conversation. The closest example I can think of that is equally cringe-inducing is two people talking about a show and an unasked third party leaning in to add, "well, I don't have a television so I can't comment."