Re:The tide is shifting: 1.3B outperforms 7B Llama 2
by Valgrim on Tuesday September 12, 2023 @06:39PM
(#37489565)
Maybe the answer is multi-step: first use curated primary sources, e.g. scientific papers. Then reinforce using well written summaries, perhaps by actual models or well graded student papers. Finally, somehow apply negative weights using wrong answers only. Bonus points if you can automate the whole process
If you have input data that includes a high rated reddit eli5 question, the content of that answer might be hard to verify, the style and way its delivered would be ideal to keep around in the training data. on the other side, technical in-depth answers have content that is worth keeping around, the style of its delivery would be very specific.
Keeping the entire internet around in your training data would still give you access to all these types of delivery still. hope that makes sense.