News for hackers. Stuff that matters.

A comment on Ask HN: Is anyone doing anything cool with tiny language models?. Parent comment

Re:Ask HN: Is anyone doing anything cool with tiny language ... by RicoElectrico on Tuesday January 21, 2025 @04:21PM (#42785333)
Llama 3.2 punches way above its weight. For general "language manipulation" tasks it's good enough - and it can be used on a CPU with acceptable speed.
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by seunosewa on Tuesday January 21, 2025 @05:17PM (#42785773)
How many tokens/s?
[ Parent | on HN ]
Re:Ask HN: Is anyone doing anything cool with tiny language ... by iamnotagenius on Wednesday January 22, 2025 @07:58AM (#42792310)
10-15t/s on 12400 with ddr5
[ Parent | on HN ]