News for hackers. Stuff that matters.

A comment on GPT-4 performs significantly worse on coding problems not in its training data. Parent comment

Re:GPT-4 performs significantly worse on coding problems not... by ZvG_Bonjwa on Saturday March 25, 2023 @05:41AM (#35301038)
I ask this earnestly, but have you tried it? It most certainly can write a pretty huge variety of code. Yes, it does often have errors, and it struggles with novel or complex problems (as the article points out), but for well known languages and frameworks it is still insanely impressive.
[ Parent | on HN ]
Re:GPT-4 performs significantly worse on coding problems not... by grumpyprole on Saturday March 25, 2023 @08:08AM (#35301853)
I tried it yes, it did not go well. First it gave me a snippet that looked correct but was not what I was asking for (I guess similar to a search engine). When I tried to point out why the proposed solution did not solve the problem, it could not modify it correctly. It kept oscillating between two incorrect solutions.
[ Parent | on HN ]