I think the bitter lesson kicks in shortly after you complete fine tuning, and openai release their next model which performs better at the same task.