News for hackers. Stuff that matters.
Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by sterlind on Wednesday March 29, 2023 @01:58AM (#35353204)
I misspoke. My question is whether the model was fine-tuned on multiple prompt/response pairs (with later prompts referencing earlier ones) or only on one-shot prompts. I expect fine-tuning on e.g.:

User: Pick an animal. Bot: Horse User: How many legs does it have? Bot: 4

to be different from just fine-tuning it on User: Pick an animal. Bot: Horse

Especially when it comes to e.g. training the bot to ask follow-up questions, etc.

There are no comments on this comment yet.