Is next token prediction the new "E = mc2"?
History has taught us that the most significant discoveries of formulas are often those that seem to be the simplest equations (even seem too simplistic to be true) but generalize the most.Take Einstein's E = mc2 as an example.My (maybe purely philosophical) hypothesis is now: Next token prediction might be for AI, what "E = mc2" has been for physics.When Ilya Sutskever was asked...