Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Gemma 2: Improving Open Language Models at a Practical Size [pdf]. Parent comment
If you have a bunch of small prompts/answers, you can fit them into bigger batches if you use start/stop tokens.
There are no comments on this comment yet.
If you have a bunch of small prompts/answers, you can fit them into bigger batches if you use start/stop tokens.