News for hackers. Stuff that matters.

A comment on Show HN: I RL-trained an agent that trains models with RL (for –$1.3k). Parent comment

Re:Show HN: I RL-trained an agent that trains models with RL... by saberience on Tuesday July 14, 2026 @09:58AM (#48906991)
Well, you say that, but when "measuring" anything in RL, that measurement itself is not always obvious.

That is, creating the scoring system/judge models etc for RL is not easy at all. You can easily create an RL loop which is getting better and improving its scores, but actually the result is totally garbage, because you're measuring the wrong thing.

[ Parent | on HN ]
Re:Show HN: I RL-trained an agent that trains models with RL... by babelfish on Tuesday July 14, 2026 @01:03PM (#48909868)
What do you see wrong with the OPs reward design?
[ Parent | on HN ]
Re:Show HN: I RL-trained an agent that trains models with RL... by willleeney on Monday July 20, 2026 @07:22AM (#48977254)
They said that the we are moving towards " `define good for the model` (success criteria/rubrics)" and you've just gone no no, you don't understand you need to measure the right thing. Feels like you've just completely agreed with them?
[ Parent | on HN ]