News for hackers. Stuff that matters.

A comment on Gemma 2: Improving Open Language Models at a Practical Size [pdf]. Parent comment

Re:Gemma 2: Improving Open Language Models at a Practical Si... by moffkalast on Thursday June 27, 2024 @10:56AM (#40811205)
The 4k sliding window context seems like a controversial choice after Mistral 7B mostly failed at showing any benefits from it. What was the rationale behind that instead of just going for full 8k or 16k?
[ Parent | on HN ]
Re:Gemma 2: Improving Open Language Models at a Practical Si... by alekandreev on Thursday June 27, 2024 @12:18PM (#40812177)
This is mostly about inference speed, while maintaining long context performance.
[ Parent | on HN ]