News for hackers. Stuff that matters.
Re:Sorry, but a new prompt for GPT-4 is not a paper by brookst on Tuesday December 05, 2023 @08:52AM (#38530647)
Wouldn’t the “thoroughly worked through” part be analogous to extensive measurements of a prompt?
Re:Sorry, but a new prompt for GPT-4 is not a paper by aleph_minus_one on Tuesday December 05, 2023 @11:14AM (#38532774)
Let me put it this way: you can expect that a typical good math paper means working on the problem for, I would say, half a year (often much longer). I have a feeling that most papers that involve extensive measurements of prompts do not involve 1/2 to 1 year of careful

- hypothesis building

- experimental design

- doing experiments

- analyzing the experimental results

- doing new experiments

- analyzing in which sense the collected data support the hypothesis or not

- ...

work.