News for hackers. Stuff that matters.

A comment on WebGPU GPT Model Demo.

Re:WebGPU GPT Model Demo by ianpurton on Friday April 21, 2023 @05:04AM (#35651337)
Question. I can see in the code the WGSL that's needed to implement inference on the GPU. https://github.com/0hq/WebGPT/blob/main/kernels.js

Could this code also be used to train models or only for inference?

What I'm getting at, is could I take the WGSL and using rust wgpu create a mini ChatGPT that runs on all GPU's?

[ Parent | on HN ]
Re:WebGPU GPT Model Demo by HopenHeyHi on Friday April 21, 2023 @05:42AM (#35651578)
No, that is not how that works, sadly you cannot.
[ Parent | on HN ]
Re:WebGPU GPT Model Demo by FL33TW00D on Friday April 21, 2023 @07:59AM (#35652453)
Why not? You could absolutely write the training code in WGSL.
[ Parent | on HN ]
Re:WebGPU GPT Model Demo by spencerchubb on Friday April 21, 2023 @10:17AM (#35654118)
This repo only does inference but it should be possible to write training code that runs on WebGPU.
[ Parent | on HN ]