News for hackers. Stuff that matters.

A comment on Type-constrained code generation with language models. Parent comment

Re:Type-constrained code generation with language models by imtringued on Wednesday May 14, 2025 @06:33AM (#43982899)
Your reward function can simply be the distance between the constrained output and the unconstrained output, that way you won't even need synthetic data, just a dataset of prompts to RL against.
[ Parent | on HN ]
Re:Type-constrained code generation with language models by informal007 on Wednesday May 14, 2025 @11:33PM (#43991578)
How to get "unconstrained output" and evaluate the distance between them?

Evaluation method which can decide distance between two sentences is hard to find, best option is closed-source LLM API even it's not the most ideal option. As a result, we also must use current LLM to improve our models.

[ Parent | on HN ]