Re:Teaching GPT-3 to reverse words
by yunyu on Monday May 16, 2022 @06:20PM
(#31403814)
You can update the "graph edges" with content longer than the window by fine tuning: https://beta.openai.com/docs/guides/fine-tuning
[ Parent
| on HN ]
Yes, training the model is where it learns, not in prompts. Prompting might be considered meta-learning but it will always need a reference point given to it from its training data, and beyond the prompt the original model is never altered.