News for hackers. Stuff that matters.
Re:The Case That A.I. Is Thinking by XenophileJKO on Tuesday November 04, 2025 @02:19AM (#45808264)
I'm genuinely curious what you work on that is so "novel" that an LLM doesn't work well on?

I feel like so little is TRUELY novel. Almost everything is built on older concepts and to some degree expertise can be applied or repurposed.

Re:The Case That A.I. Is Thinking by geon on Tuesday November 04, 2025 @04:11AM (#45808920)
It doesn't have to be very novel at all. Anything but the most basic TODO-list app.
Re:The Case That A.I. Is Thinking by EagnaIonat on Tuesday November 04, 2025 @02:47AM (#45808436)
Anything relatively new in a technology LLMs struggle with, especially if the documentation is lacking.

Godot for example in ChatGPT.

It may no longer still be the case, but the documentation for GoDot was lacking and often samples written by others didn't have a version number associated with it. So samples it would suggest would never work, and even when you told it the version number it failed to generate workable code.

The other stuff I've noticed is custom systems. One I work with is a variation of Java, but LLMs were treating it as javascript. I had to create a LoRA just to get the model from not trying to write javascript answer. Even then it could never work, because it had never been trained on real world examples.

Re:The Case That A.I. Is Thinking by aydyn on Tuesday November 04, 2025 @03:25AM (#45808674)
Literally anything in the science domain. Adding features to your software app is indeed usually not novel.
Re:The Case That A.I. Is Thinking by bongodongobob on Tuesday November 04, 2025 @03:29AM (#45808698)
That's where the bar is now?
Re:The Case That A.I. Is Thinking by aydyn on Tuesday November 04, 2025 @03:38AM (#45808744)
huh?