1. Completely stops hallucinating, since we can demand it to internally prove its claims before showing the answer;
2. Stops outputting incorrect code (for the same reason);
3. Starts being capable of outputting complete projects (since it will now be able to compose pieces into a larger code);
4. This is also what is needed for an AI to start self-improving (as it will now be able to construct better architectures, in a loop).
That's why I argue getting the AI competent in logical reasoning is the most important priority, and we'll have no AGI until it does. After all, humans are perfectly capable of learning how to use a proof assistant.
Moreover, if an AI can't learn it no matter how hard it tries, you can argue that there is at least one human capability that the AI can't replicate, thus it isn't an AGI.
Maybe not in this century. If you told a medieval farmer that in the future millions of people fly throughout the sky inside giant hunks of metal he wouldn't believe you either.
Do you really think their primary goal is "make a lot of money"?
Why? Do you use formalized logic when discussing with other people about topics that involve logic? You know, a logic riddle or a philosophical question can be understood and processed even if the only tool you have is your native language. Formalized logic is a big prerequisite that basically cuts out the vast majority of Earth population (just like coding). Now, if you mean that in BENCHMARKS they should use formalized logic syntax, probably yes. But in addition to plain language tests.