News for hackers. Stuff that matters.

A comment on Viking 7B: open LLM for the Nordic languages trained on AMD GPUs. Parent comment

Re:Viking 7B: open LLM for the Nordic languages trained on A... by worldsayshi on Wednesday May 15, 2024 @01:19PM (#40369766)
I guess you mean non-textual data then because the amount of text data they are being trained on ought to be enough for agi by now?

Some kind of diminishing returns asymptote from text volume alone must have been hit a long time ago.

[ Parent | on HN ]
Re:Viking 7B: open LLM for the Nordic languages trained on A... by imtringued on Wednesday May 15, 2024 @01:27PM (#40369872)
It's not the amount that is wrong, it's how the model is trained. The model is trained for zero and few shot tasks. It is not surprising that it is performing well when you ask for that.
[ Parent | on HN ]