News for hackers. Stuff that matters.
Re:Understanding, using, and finetuning Gemma by andy99 on Saturday February 24, 2024 @11:23AM (#39492717)
Is the 2B measured like that as well? I did use it with llama.cpp and noticed it ran slower than I expected.

That's the danger of too much abstraction, it's easy to have big gaps in one's understanding of what's really going on.

Re:Understanding, using, and finetuning Gemma by rasbt on Saturday February 24, 2024 @11:36AM (#39492841)
Yes, it's somewhat similar to the 2B model as it uses the same vocabulary size.