Re:The Super Effectiveness of Pokémon Embeddings Using Only ...
by rolisz on Monday July 01, 2024 @02:39AM
(#40843180)
BERT was not large (it was under a billion parameters). And it wasn't an autoregressive language model like GPT
[ Parent
| on HN ]
Re:The Super Effectiveness of Pokémon Embeddings Using Only ...
by refulgentis on Monday July 01, 2024 @03:11AM
(#40843318)
Relative to today's models, it is small.
For the time, it was large.
Re: that it's not auto regressive, that's correct.
Things built on eachother smoothly. Transformers to BERT to GPT.