That is hilarious.

"write a program that list files"

"Sure! First let's implement a file system, and the operating system around it, and design the hardware that runs it..."

Reminds of a some programmers and researchers I know...

If you wish to make ls from scratch you must first invent the universe.

> Noted for next time.

Is that just something it says, or will that actually affect how it will behave next time?

Well, it could make a note in its memory and reference it later. I don't know if such a statement from the LLM would actually cause a write to the memory in all cases, though.

I find that claude rarely uses its memories.

You can configure that. It's a feature called memory in claude/chatgpt web. For claude code, take a look at CLAUDE.md.

My experience is that unless it actually writes it down somewhere, it's almost definitely going to forget within the next time or two that the context gets compacted. Even if it does write a rule down, it still may or may not actually follow the rule because it just becomes one additional piece of context to weigh alongside everything else.

To be clear, none of this is specific to Claude as much as just a property of how these tools work. Certain models might be better or worse at making the right calls here, but the fundamental constraint of context limiting how much knowledge can be retained and a "rule" in context, whether written down in advance or manually remembered for the time being, is not a guarantee it will be followed.

Lol

That's an "overthinking" model.