Re:GPT-4
by gwern on Wednesday March 15, 2023 @12:28PM
(#35170755)
It's the same thing. Predict the next pixel, or the next token (same way you handle regular images), or infill missing tokens (MAE is particularly cool lately). Those induce the abstractions and understanding which get tapped into.
[ Parent
| on HN ]
There are no comments on this comment yet.