News for hackers. Stuff that matters.
Re:Groqchat by chihuahua on Friday December 22, 2023 @11:15PM (#38741585)
> the quality of the response isn't really what we're looking for here. We're looking for speed i.e. tokens per second.

But if it was generating high-quality responses, would that not make it go slower?

Re:Groqchat by nomel on Saturday December 23, 2023 @02:54AM (#38742466)
That would involve using a different model. This is not about the model, it’s about the relative speed improvement from the hardware, with this model as a demo.