what's crazy to think about is what new things will become possible as the context window sizes creep up.
Once again it's a kind of backhanded milestone for AI that in less than a year the goalposts have moved from "can it even once hold a half-coherent conversation" to "if anyone can think of a question it can't answer then it's dumb and not AI".
I do think, though, that one of the rewards of making LLMs promising was the discovery that the bar for “what is useful” for any task is higher than what the average person can do. That could be seen as moving the goalposts, but another way of looking at it is: we’ve finally bothered to install a scoreboard.
Like, if a person can’t solve a quadratic equation, they probably just aren’t useful for manipulating equations. Which is fine, of course, the average person is also not a very good hammer or screwdriver.
We’re all specialized, the bar for usefulness is probably something more like “how would a person who’s taken an intro college course on this do it.”
Has the Singularity already happened, and was it us?
Q:
Provide the quadratic roots of the following equation. Work out the answer step by step.
21 - 135 x + 19 x^2 = 0
A:
Okay, here are the step-by-step workings:
1) Start with the quadratic equation: 21 - 135x + 19x^2 = 0
2) Group the x^2 and x terms together: 19x^2 - 135x + 21 = 0
3) Use the quadratic formula to find the roots: x = (-b ± sqrt(b^2 - 4ac)) / 2a Where: a = 19 b = -135 c = 21
4) Substitute the values into the formula: x = (-(-135) ± sqrt((-135)^2 - 4(19)(21))) / 2(19)
5) Simplify: x = (135 ± sqrt(18225 - 1596)) / 38
6) Evaluate the square root: x = (135 ± 135) / 38
7) The two roots are: x = 5 x = 3
Therefore, the roots of the quadratic equation 21 - 135x + 19x^2 = 0 are x = 5 and x = 3.
I always find it weird people are obsessed with LLMs being unable to solve quadratic equations or recite pi to some digit or play chess. That’s not the interesting abilities they demonstrate, and we already have techniques that do those tasks as good as you would ever need or want. But we have never had something that can operate in a natural language space and “reason” in that abstract space so effectively. That language alone is sufficient to bring out such amazing capabilities is cool, and mixing models and techniques using LLM as a glue between them will be (IMO) where they really change things.