News for hackers. Stuff that matters.
Re:Ilya Sutskever's SSI Inc raises $1B by svnt on Wednesday September 04, 2024 @03:23PM (#41449599)
Transformers in 2017 as the basis, but then the quantization-emergence link as a grad student project using spare time on ridiculously large A100 clusters in 2021/2022 is what finally brought about this present moment.

I feel it is fair to say that neither of these were natural extrapolations from prior successful models directly. There is no indication we are anywhere near another nonlinearity, if we even knew how to look for that.

Blind faith in extrapolation is a finance regime, not an engineering regime. Engineers encounter nonlinearities regularly. Financiers are used to compound interest.

There are no comments on this comment yet.