News for hackers. Stuff that matters.
Re:Godot-dodo – Finetuning LLaMA on single-language comment:... by minosu on Sunday April 23, 2023 @08:44PM (#35682348)
The wrapping prompt is also used during inference. (https://github.com/minosvasilias/godot-dodo/blob/f62b90a4622...) Prompting like this is useful for instruct-finetunes, and similar prompts are used by other projects like stanford-alpaca.
Re:Godot-dodo – Finetuning LLaMA on single-language comment:... by the_tli on Sunday April 23, 2023 @08:48PM (#35682377)
Thanks for the clarification, makes sense now!