I actually assumed that this was actually creating ROMs.

I wonder if you could somehow use a large multimodal model trained on all of the existing NES software machine code along with manuals, forums and videos for each game. If it's not enough training data, maybe include other 6502 software, with the platforms encoded to differentiate?

Then you get a model that can take a description of a game and maybe a proposed screenshot and generate a new ROM. You train it further by testing the ROMs and giving feedback, starting with negative feedback for ROMs that don't boot.

The knowledge how to program on old systems like the NES is located sparsely on the Internet and there aren't many coding examples. A LLM would have a very difficult time producing a cartridge ROM with no single-byte errors. Even multiple iterations wouldn't iron out the errors. The closest thing you could do would be construct a template and have the LLM fill in the graphics or text, but that's not versatile at all.

Seems possible with LORA versions of them like stable diffusion uses it for modular recombination.

As far as not being able to produce machine code without even a single byte error of consequence, true, it's questionable whether that's possible. But I'm not sure that is proven impossible with LLMs? So I think it's worth testing it.

I was thinking of training it on all of the 6502 compatible machine code that's out there. There are at least 20,000 or 30,000 programs.

One day, it might also be capable of creating games, similar to what’s shown in this post: https://news.ycombinator.com/item?id=38754607

Does anyone having a link to an example game running in an emulator?

It's just an image generator.

When i selected game of thrones, it generated an image hapily. When i asked it to do it again but different if gave me a copyright error. When i explained that it had already done it for me, it said, "Oh, Sorry! Here's what you asked for!"

I asked for South Park and it complained about copyright so I asked for east park where any connection to South Park would be completely accidental and happily obliged to create ~south~ east park

I asked for "Mario vs alien" and it gave a copyright error. Then I asked for "Italian plumber vs alien" and it did a nice image of Mario fighting aliens.

Paywall!

It’s also a GPT to capture email addresses …

/sarcasm