however if they've really got something that can eventually solve math problems better than wolfram alpha / mathematica that's great, i got real disappointed early in chatgpt being entirely useless at math.
lemme know when the "AGI" gets bored and starts grinding through the "List of unsolved problems in mathematics" on its own and publishing original research that stands up to scrutiny.
/s, maybe.
If this model is more along the lines of what DeepMind is doing starting from scratch and building up learnings progressively, then depending on (a) how long it was running, (b) what it was fed, and (c) how long until it is expected to hit diminishing returns, then potentially solving grade school math might be a huge deal or a nothing burger.
The details really matter quite a lot.
Once they have a system capable of settling on a single correct answer through its own reasoning rather than yet another probability, it it gets much easier to build better and better AI with a series of incremental improvements. Without this milestone they might've just kept on building LLM's all with the same fundamental limitations, no matter how much computing power they add to them.
> Given vast computing resources, the new model was able to solve certain mathematical problems, the person said on condition of anonymity because they were not authorized to speak on behalf of the company. Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said.