Also the level of fault tolerance... if your pixels are a bit blurry, chances are no one notices at a high enough resolution. If your json is a bit blurry you have problems.
You can do "constrained decoding" on a code model which keeps it grammatically correct.
But we haven't gotten diffusion working well for text/code, so generating long files is a problem.
Recent results for code diffusion here: https://www.microsoft.com/en-us/research/publication/codefus...
I'm not experienced enough to validate their claims, but I love the choice of languages to evaluate on:
> Python, Bash and Excel conditional formatting rules.
Not in theory, but the level of complexity is way higher and the amount of data available is much smaller.
Compare bitmaps to this: https://fossies.org/linux/blender/doc/blender_file_format/my...