Designing programming languages beyond AI comprehension
What characteristics should a programming language have in order to make automated analysis, replication, and learning by artificial intelligence systems difficult? Any idea?
(
12 comments
| 4 points
| on HN
)
Change capitalization of keywords based on filename length. If for odd length IF for even. iF for prime numbers.
variables named in English are strongly typed, variables in Spanish are weakly typed.
change symbols based on line absolute number. && on even lines AND on odd.
line terminators differ based on the number of consonants in the method name
every 5th consecutive line should begin with the symbol for comments unless there's a real comment more than 10 lines above but less than 23.
closing brackets are left brackets when the file-size is over 3k
switch assignment evaluation left vs right based on folder depth.
all conditions that an IDE could handle in a rote, calculated way real-time but would probably make the training data nonsensical. An LLM might produce the code based on language features but likely will never get the syntax right making any LLM output largely useless.
I'd make that so it's on even significant lines of code.
So you can't just leave a blank line to leave the rest of the file syntactically correct.
And of course enforce no braces on single line bodies, and enforce the first brace to be on the next line as the if/for/whatever statement (so that the parity of the SLOC number changes if a single statement body turns into a two statement body)
A private blockchain is just a database.
If that pattern is figured out, im sure it can be used to train an LLM to 'comprehend' that programming language. Think of it like designing a cipher or a puzzle; you can create a very complex cipher that is understood only by you or those you choose to share it with. But if the 'trick' is revealed, then the entire cipher is broken.
The approaches suggested here (context-dependent syntax, position-based keywords, etc.) don't make a language "unlearnable" - they just make it require more training data. An LLM that's seen enough examples of your filename-length-dependent IF/If/iF keywords will learn the pattern just fine. You've increased the Kolmogorov complexity of the spec, but not made it incomprehensible.
The only way to truly prevent AI comprehension is to make the language incomprehensible to humans too. Which defeats the purpose.
A more pragmatic question: what problem are you trying to solve? If it's "prevent AI from writing code in my language," that's unwinnable - any pattern a human can learn, a sufficiently large model can learn. If it's "make codebases harder to reverse engineer," you want obfuscation not language design. If it's "preserve human jobs," the bottleneck isn't whether AI can write code - it's whether AI can figure out what code to write in the first place.