Prompts are super finicky because they are essentially performing decompression.

You have to create a function that for a given set of inputs the entire generated token sequence is part of a set of text that an external observer will consider true.

I recall there was a paper with a similar title recently… https://arxiv.org/abs/2309.10668