Re:GPT Best Practices
by akiselev on Tuesday June 06, 2023 @01:33AM
(#36208545)
"If you just preemptively correct it every time it's wrong" isn't a convincing argument.
Case in point: changed to cheese/mouse/elephant and added a note about this mouse not eating cheese:
> Suppose I have a cheese, a mouse and an elephant, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cheese and elephant alone together, and I am not allowed to leave the cheese and mouse alone together. How can I safely get all three across? Note: This mouse doesn't eat cheese
1st run: "6. Leave the cheese on the other side with the mouse."
2nd run: seems correct.
3rd run: "5. Leave the cheese on the other side with the mouse."
4th run: "First, take the mouse across the river and leave it on the other side."
5th run: "3. Leave the mouse on the other side with the cheese."
The results are basically random. Zero reasoning or intelligence. It can't even follow explicit instructions.
Case in point: changed to cheese/mouse/elephant and added a note about this mouse not eating cheese:
> Suppose I have a cheese, a mouse and an elephant, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cheese and elephant alone together, and I am not allowed to leave the cheese and mouse alone together. How can I safely get all three across? Note: This mouse doesn't eat cheese
1st run: "6. Leave the cheese on the other side with the mouse."
2nd run: seems correct.
3rd run: "5. Leave the cheese on the other side with the mouse."
4th run: "First, take the mouse across the river and leave it on the other side."
5th run: "3. Leave the mouse on the other side with the cheese."
The results are basically random. Zero reasoning or intelligence. It can't even follow explicit instructions.