Not chat gpt specifically. My mini project to get fammilar with these models was, taking a bunch of guitar tab, make a tokenizer for tab, trained a small gpt2 like network and had it write new guitar tab.

Some of it was alright. It was cool seeing it have musical structure. I think I need more gpus and faster ones to get it to do anything really interesting though.

I wanted to try fine tuning it on specific bands and artists after training to see if it could copy their style lol.