Re:The Secret Sauce behind 100K context window in LLMs: all ...
by version_five on Saturday June 17, 2023 @08:27PM
(#36376149)
Complete anecdote but the other day I was using chatgpt, prompting with a long context and then an instruction. I was at the maximum size it would let me enter, having trimmed it until it accepted the input. With the question at the end, it ignored it and just gave some generic reaction to the context. With the question at the beginning it worked as expected. Maybe just a fluke, interesting to see the guidance on Claude is the opposite (and more what I would have thought).
[ Parent
| on HN ]
Re:The Secret Sauce behind 100K context window in LLMs: all ...
by keskival on Saturday June 17, 2023 @09:02PM
(#36376320)
This happened to me too recently, but for me it was because I used headings in the priming text, so it didn't quite get the instructions came after the last stuff.
Fixed by adding ------- line between the materials and the question in the end.