Ah, interesting. I didn't notice that. I have noticed that chatgpt is really impressive at doing rhyming poems/songs, and many of its generated poems sound similar to each other. I also don't remember raw gpt-3 being so good at poems.

So I wonder if there was substantial fine-tuning for chatgpt specifically to reward it to generate poems, in a particular style.

And here, it's "over indexing" on that and still generating poems in that familiar style