GPT-4 is getting worse over time, not better

Re:GPT-4 is getting worse over time, not better by csmpltn on Wednesday July 19, 2023 @03:13PM (#36791693)

> "GPT-4, back then, ported dirbuster to POSIX compliant multi-threaded C by name only. It required three prompts."

I had early access to GPT-4.

I don't know the first thing about you. I don't want to call you a liar, or an AI bro, influencer, etc.

I couldn't get GPT-4 to output the simplest of C programs (a 10-liner, think "warmup round" programming interview question). The first N attempts wouldn't build. After fixing them manually - the programs all crash (due to various printf, formatting, overflow issues). I tried numerous times.

Pretty much every other interaction with GPT-4 since then was similarly disappointing and shallow (not just programming tasks - but also information extraction, summarization, creative writing, etc).

I just can't bring myself to fall for the hype.

[ Parent | on HN ]

Re:GPT-4 is getting worse over time, not better by r3trohack3r on Wednesday July 19, 2023 @04:33PM (#36792838)

I still have the chat:

https://chat.openai.com/share/842361c7-7ee5-49a3-9388-4af7c5...

I misremembered, I fixed the `/` prefix myself, it was a one character fix and not worth the effort. The diff it generated came later since my television never returns a 404.

Though, admittedly, I just re-prompted GPT-4 with the same prompts and ended up with similar output - so maybe not the best example of a regression?

[ Parent | on HN ]