Doing this a couple of times gives me 100% accuracy for my use case that involves some level of summarization and reasoning.
Hallucinations are not as big of a deal at all IMO. Not enough that I'll just sit there and wait for models that don't hallucinate.
for popular languages, though for JS it most of the time outputs obsolete syntax and code.
Today i tried to do a bit of scripting with my son in Garrys Mod, it uses Expression 2 for a Wiremod module. GPT hallucinated a lot of functions and the worst part it switched almost each time from e2 to lua.
It is good at solving homeworks for students, or solving popular problems in popular languages and libraries though it might give you an ugly solution and ugly code, it is probably trained on bad code too and it did not learn to prefer good code over bad code.
(And I don’t mean to be rude - I just really hate that syntax!)
The other good use cases are using LLM to turn natural language prompts into API calls to real data.