Re:WebGPU GPT Model Demo
by zamadatix on Thursday April 20, 2023 @11:47PM
(#35649638)
I don't have exact numbers but trying all 3 out: on a local 4090 this seems mildly slower than GPT-4 and ridiculously slower than GPT 3.5 (both via cloud GPUs of course). That said all are within the realm of usability in terms of speed though GPT 3.5 is really in a whole different class of being able to be used nearly interactively without delay.
[ Parent
| on HN ]
There are no comments on this comment yet.