Re:Self-reasoning tokens: teaching models to think ahead
by XenophileJKO on Saturday April 20, 2024 @08:02PM
(#40102100)
Well in this specific case, the logic I was asking the model to do was. (Highly paraphrased..)
1. Inventory the retrieved items.
2. Determine their relevance.
3. Pick the most relevant or if none of the retrieved items is relevant return an alternative message.
What the model will do is add new items into (1) if none of the retrieved items are relevant. If you add some steps between 1 and 2.. it stops doing that.
1. Inventory the retrieved items.
2. Determine their relevance.
3. Pick the most relevant or if none of the retrieved items is relevant return an alternative message.
What the model will do is add new items into (1) if none of the retrieved items are relevant. If you add some steps between 1 and 2.. it stops doing that.