News for hackers. Stuff that matters.
Re:Show HN: Fine-tune your own Llama 2 to replace GPT-3.5/4 by kelseyfrog on Tuesday September 12, 2023 @05:44PM (#37488904)
Is that because translation is typically an encoder-decoder task and llama is decoder only or is there something else about it that makes the last difficult for llama?
Re:Show HN: Fine-tune your own Llama 2 to replace GPT-3.5/4 by FeepingCreature on Tuesday September 12, 2023 @06:50PM (#37489681)
If you don't make it learn other-language texts, it won't be able to speak that language.
Re:Show HN: Fine-tune your own Llama 2 to replace GPT-3.5/4 by mikewang on Thursday September 14, 2023 @02:07AM (#37505519)
As I learned that 85% of its trainig data is English. Othere languanges composed of 15%.