Re:Searching for DeepSeek's glitch tokens
by astrange on Sunday January 26, 2025 @12:42AM
(#42827993)
Bitter lesson says any kind of specialization is not worth it[0]. Also, you want to be able to have mixed language conversations, like defining a Chinese word in English.
[0] but it might be worth it if you need a smaller model because then there are tradeoffs again.
[0] but it might be worth it if you need a smaller model because then there are tradeoffs again.