Got it, thanks. Alright that makes sense. I haven't really tried much at this point, though I have had ChatGPT give me a few "I can't do that" and I've had to be like "no, seriously, I'm doing this because it's a good thing" in the past (3.5 days).

Fine tuning does seem like a good idea.