News for hackers. Stuff that matters.

A comment on Viking 7B: open LLM for the Nordic languages trained on AMD GPUs. Parent comment

Re:Viking 7B: open LLM for the Nordic languages trained on A... by coffeebeqn on Wednesday May 15, 2024 @12:55PM (#40369447)
Perform better how? Knowing more languages gives you more data and different points of view rather than just using the English corpus and culture. When I ask chatgpt for a translation it seems to understand the meaning behind the words and finds the closest thing in the other language. The datasets seem to merge in some way
[ Parent | on HN ]
Re:Viking 7B: open LLM for the Nordic languages trained on A... by ClarityJones on Wednesday May 15, 2024 @02:11PM (#40370397)
Fair, but there may be overhead that doesn't need to exist. Certainly - for the limited compute my brain can accomplish - I could gain a deeper understanding of physics, if I focused on learning physics and didn't also have to simultaneously learn French.
[ Parent | on HN ]
Re:Viking 7B: open LLM for the Nordic languages trained on A... by staticman2 on Wednesday May 15, 2024 @03:49PM (#40371530)
Wouldn't a better metaphor be if a child growing up in a bilingual household would be worse at physics as an adult? My guess would be growing up bilingual would have no impact.
[ Parent | on HN ]
Re:Viking 7B: open LLM for the Nordic languages trained on A... by fikama on Thursday May 16, 2024 @05:28AM (#40376560)
This hypotetical kid would have the same size of brain/number of neurons anyway. In case of LLMs one could create a model that could be smaller thakns to not including the knowlegde about unecessary languages. A problem though could be with lacking traing data in other languages.
[ Parent | on HN ]
Re:Viking 7B: open LLM for the Nordic languages trained on A... by olddustytrail on Wednesday May 15, 2024 @02:39PM (#40370710)
In the short term. In the longer term you'll understand concepts better when you're multilingual.
[ Parent | on HN ]
Re:Viking 7B: open LLM for the Nordic languages trained on A... by NhanH on Wednesday May 15, 2024 @02:15PM (#40370449)
Human is not limited by computational power of brain (or rather, it is not the limitation we encounter). We are limited by time and the fact that our machinery degrades with time (aging).
[ Parent | on HN ]