Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Large language models reduce public knowledge sharing on online Q&A platforms. Parent comment
E.g. you can't just synthetically generate code, something or someone needs to run it and see if it performs the functions you actually asked of it.
You need to feed the LLM output into some kind of formal verification system, and only then add it back to the synthetic training dataset.
Here, for example - dumb recursive training causes model collapse:
https://www.nature.com/articles/s41586-024-07566-y
E.g. you can't just synthetically generate code, something or someone needs to run it and see if it performs the functions you actually asked of it.
You need to feed the LLM output into some kind of formal verification system, and only then add it back to the synthetic training dataset.
Here, for example - dumb recursive training causes model collapse:
https://www.nature.com/articles/s41586-024-07566-y