Re:Phi-3 Technical Report
by woodson on Tuesday April 23, 2024 @12:44PM
(#40133979)
Especially for small models I had very bad results for use in translation. Even trying all kinds of tricks didn’t help (apparently prompting in the target language helps for some). Encoder-decoder models such as FLAN-T5 or MADLAD-400 seemed far superior at equal or even smaller model size.
[ Parent
| on HN ]