News for hackers. Stuff that matters.
Re:Show HN: I built a better UI for ChatGPT by SomewhatLikely on Tuesday March 07, 2023 @10:41AM (#35056551)
I think the slow responses are the real generation rate when you time share the GPU. If you are willing to let GPUs occasionally sit idle though, you can probably get a faster generation rate by dedicating more of the GPU time to that one client.

There are no comments on this comment yet.