fdondi

Also it seems this is a task for which a model could be strongly fine-tuned. We just need a dataset of typical interactions...

Does it only work with ChatGPT? Seems it would be useful also for local Llamas etc.

Wait, so we are asking the innkeeper if the wine is good? If the model thinks say that the current year is 2021 it will rate higher a response that does?

There should be at a minimum a way to print which comparisons were made, so that you could double-check if you agree with those.

Also, we could modify the prompt to explain why the decision was made.