News for hackers. Stuff that matters.
Re:Phi-3 Technical Report by mlyle on Tuesday April 23, 2024 @12:05AM (#40128376)
> at ~1,000 tokens/sec

12 tokens per second.

Re:Phi-3 Technical Report by moralestapia on Tuesday April 23, 2024 @07:53AM (#40130855)
Whoops, made the same mistake as @ignoramous :P