I wrote a whole paper and contributed a GitHub repo and HF space about using filters applied to the LLMs vocabulary before decoding to solve a huge problem with hard constrained text generation in LLMs.

https://paperswithcode.com/paper/most-language-models-can-be...