News for hackers. Stuff that matters.
Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Monday January 19, 2026 @06:48PM (#46686186)
There is no RL for programming languages. Especially ones w/ no significant amount of code.
Re:Nanolang: A tiny experimental language designed to be tar... by whimsicalism on Monday January 19, 2026 @06:51PM (#46686201)
not even wrong
Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Monday January 19, 2026 @06:55PM (#46686233)
Exactly.
Re:Nanolang: A tiny experimental language designed to be tar... by nl on Monday January 19, 2026 @11:53PM (#46688039)
I guess the op was implying that is something fixable fairly easily?

(Which is true - it's easy to prompt your LLM with the language grammar, have it generate code and then RL on that)

Easy in the sense of "it is only having enough GPUs to RL a coding capable LLM" anyway.

Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Tuesday January 20, 2026 @12:24AM (#46688211)
If you can generate code from the grammar then what exactly are you RLing? The point was to generate code in the first place so what does backpropagation get you here?
Re:Nanolang: A tiny experimental language designed to be tar... by nl on Tuesday January 20, 2026 @06:07AM (#46690540)
Post RL you won't need to put the grammar in the prompt anymore.
Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Tuesday January 20, 2026 @03:06PM (#46697085)
The grammar of this language is no more than a few hundred tokens (thousands at worst) & current LLMs support context windows in the millions of tokens.
Re:Nanolang: A tiny experimental language designed to be tar... by nl on Tuesday January 20, 2026 @04:53PM (#46698235)
Sure.

The point is that your statement about the ability to do RL is wrong.

Additionally your response to the Deepseek paper in the other subthread shows profound and deliberate ignorance.

Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Tuesday January 20, 2026 @06:37PM (#46699193)
Theorycrafting is very easy. Not a single person in this thread has shown any code to do what they're suggesting. You have access to the best models & yet you still haven't managed to prompt it to give you the code to prove your point so spare me any further theoretical responses. Either show the code to do exactly what you're saying is possible or admit you lack the relevant understanding to back up your claims.
Re:Nanolang: A tiny experimental language designed to be tar... by nl on Wednesday January 21, 2026 @12:50AM (#46701613)
> You have access to the best models & yet you still haven't managed to prompt it to give you the code to prove your point so spare me any further theoretical responses. Either show the code to do exactly what you're saying is possible

GPU poor here though...

To quote someone (you...) on the internet:

> More generally, don't ask random people on the internet to do work for you for free.

https://news.ycombinator.com/item?id=46689232

Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Wednesday January 21, 2026 @02:00AM (#46702047)
Claims require evidence & if you are unwilling to present it then admit you do not have any evidence to support your claims. It's not complicated. Either RL works & you have evidence or you do not know & can not claim that it works w/o first doing the required due diligence which (shockingly) actually requires work instead of empty theory crafting & hand waving.
Re:Nanolang: A tiny experimental language designed to be tar... by thorum on Tuesday January 20, 2026 @02:59AM (#46689104)
Go read the DeepSeek R1 paper
Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Tuesday January 20, 2026 @03:21AM (#46689232)
Why would I do that? If you know something then quote the relevant passage & equation that says you can train code generators w/ RL on a novel language w/ little to no code to train on. More generally, don't ask random people on the internet to do work for you for free.
Re:Nanolang: A tiny experimental language designed to be tar... by thorum on Tuesday January 20, 2026 @04:50AM (#46689986)
Your other comment sounded like you were interested in learning about how AI labs are applying RL to improve programming capability. If so, the DeepSeek R1 paper is a good introduction to the topic (maybe a bit out of date at this point, but very approachable). RL training works fine for low resource languages as long as you have tooling to verify outputs and enough compute to throw at the problem.
Re:Nanolang: A tiny experimental language designed to be tar... by whimsicalism on Tuesday January 20, 2026 @10:39AM (#46692942)
imo generally not worth it to keep going when you encounter this sort of HN archetype
Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Tuesday January 20, 2026 @03:04PM (#46697062)
So you should have no problem bringing up the exact passages & equations they use for their policies.
Re:Nanolang: A tiny experimental language designed to be tar... by whimsicalism on Tuesday January 20, 2026 @10:38AM (#46692934)
well, that’s one way to react to being provided with interesting reading material.
Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Tuesday January 20, 2026 @03:05PM (#46697072)
Bring up passage that supports your claim. I'll wait.
Re:Nanolang: A tiny experimental language designed to be tar... by nl on Wednesday January 21, 2026 @01:03AM (#46701709)
Not exactly sure what you are looking for here.

That GRPO works?

> Group Relative Policy Optimization (GRPO), a variant reinforcement learning (RL) algorithm of Proximal Policy Optimization (PPO) (Schulman et al., 2017). GRPO foregoes the critic model, instead estimating the baseline from group scores, significantly reducing training resources. By solely using a subset of English instruction tuning data, GRPO obtains a substantial improvement over the strong DeepSeekMath-Instruct, including both in-domain (GSM8K: 82.9% → 88.2%, MATH: 46.8% → 51.7%) and out-of-domain mathematical tasks (e.g., CMATH: 84.6% → 88.8%) during the reinforcement learning phase

Page 2 of https://arxiv.org/pdf/2402.03300

That GRPO on code works?

> Similarly, for code competition prompts, a compiler can be utilized to evaluate the model’s responses against a suite of predefined test cases, thereby generating objective feedback on correctness

Page 4 of https://arxiv.org/pdf/2501.12948

Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Wednesday January 21, 2026 @02:03AM (#46702065)
None of those are novel domains w/ their own novel syntax & semantic validators, not to mention the dearth of readily available sources of examples for sampling the baselines. So again, where does it say it works for a programming language with nothing but a grammar & a compiler?
Re:Nanolang: A tiny experimental language designed to be tar... by nl on Wednesday January 21, 2026 @07:21AM (#46704653)
To quote you:

> here is no RL for programming languages.

and

> Either RL works & you have evidence

This is just so completely wrong, and here is the evidence.

I think everyone in this thread is just surprised you don't seem to know this.

Haven't you seen the hundreds of job ads for people to write code for LLMs to train on?

Re:Nanolang: A tiny experimental language designed to be tar... by measurablefunc on Wednesday January 21, 2026 @11:48AM (#46708165)
You're not going to get less confused by doubling down. None of your claims are valid & this is because you haven't actually tried to do what you're suggesting. Taking a grammar & compiler & RLing will get you nowhere.