News for hackers. Stuff that matters.
Re:Viking 7B: open LLM for the Nordic languages trained on A... by ClarityJones on Wednesday May 15, 2024 @02:11PM (#40370397)
Fair, but there may be overhead that doesn't need to exist. Certainly - for the limited compute my brain can accomplish - I could gain a deeper understanding of physics, if I focused on learning physics and didn't also have to simultaneously learn French.
Re:Viking 7B: open LLM for the Nordic languages trained on A... by staticman2 on Wednesday May 15, 2024 @03:49PM (#40371530)
Wouldn't a better metaphor be if a child growing up in a bilingual household would be worse at physics as an adult? My guess would be growing up bilingual would have no impact.
Re:Viking 7B: open LLM for the Nordic languages trained on A... by fikama on Thursday May 16, 2024 @05:28AM (#40376560)
This hypotetical kid would have the same size of brain/number of neurons anyway. In case of LLMs one could create a model that could be smaller thakns to not including the knowlegde about unecessary languages. A problem though could be with lacking traing data in other languages.
Re:Viking 7B: open LLM for the Nordic languages trained on A... by olddustytrail on Wednesday May 15, 2024 @02:39PM (#40370710)
In the short term. In the longer term you'll understand concepts better when you're multilingual.
Re:Viking 7B: open LLM for the Nordic languages trained on A... by NhanH on Wednesday May 15, 2024 @02:15PM (#40370449)
Human is not limited by computational power of brain (or rather, it is not the limitation we encounter). We are limited by time and the fact that our machinery degrades with time (aging).