News for hackers. Stuff that matters.
Re:AI hype is built on high test scores. Those tests are flawed by james-revisoai on Tuesday October 10, 2023 @10:33AM (#37832628)
Yeah you have hit the nail on the head here. A lot was predictable with seeing that GPT-2 could reasonably stay within language and generate early coherent structures, that coming at the same time as instructions with the T5 stuff and the widespread use of embeddings from BERT told us this direction was likely, it's just for many people this came to awareness in 2021/22 rather than the 2018-2020 ramp up the field/hobbyists experienced.

There are no comments on this comment yet.