I don't know what knapsacks have to do with LLMs. I didn't say anything about search or output generation, nor did I say those are the only things transformer models can solve.