News for hackers. Stuff that matters.
Re:Grok3 Launch by plagiarist on Tuesday February 18, 2025 @09:09AM (#43089639)
Sortof a letdown that after 24 32Gb RAM sticks you only get 6-8 tokens per second.
Re:Grok3 Launch by acchow on Tuesday February 18, 2025 @12:12PM (#43092250)
And only get to use 20k context length before it OOMs
Re:Grok3 Launch by Mekoloto on Tuesday February 18, 2025 @10:01AM (#43090275)
But a token is not just a character.

"hello how are you today?" - 7 tokens.

And this is so much better than I could have imagined in a very short span of time.