You tend to oversimplify the GPT's - they don't just work all the time, you got to test how well they work, then you got to select the best prompt and demonstrations, then you got to update your prompt it as new data comes along. There is plenty of work parsing various inputs into a format it could understand and then parsing its outputs, especially for information extraction.