News for hackers. Stuff that matters.
Re:Gemma 2: Improving Open Language Models at a Practical Si... by m00x on Thursday June 27, 2024 @11:06AM (#40811360)
Not instruct tuning, you use it in general training.

If you have a bunch of small prompts/answers, you can fit them into bigger batches if you use start/stop tokens.

There are no comments on this comment yet.