News for hackers. Stuff that matters.
Re:Qwen2 LLM Released by z4y5f3 on Friday June 07, 2024 @04:54PM (#40612863)
My experience is that < 500M models are pretty useful when fine-tuned on traditional NLP tasks, such as text classification and sentence/token level labeling. A modern LM with a 32K context window size could be a nice replacement for BERT, RoBERTa, BART.

There are no comments on this comment yet.