WebGPU GPT Model Demo

Re:WebGPU GPT Model Demo by DustinBrett on Thursday April 20, 2023 @10:26PM (#35649120)

It indeed works and loads quick. I am more interested currently in the Vicuna 7B example from https://mlc.ai/web-llm/

Also instead of just "Update Chrome to v113" the domain owner could sign up for an origin trial https://developer.chrome.com/origintrials/#/view_trial/11821...

[ Parent | on HN ]

Re:WebGPU GPT Model Demo by fredrickd on Thursday April 20, 2023 @11:00PM (#35649332)

Thanks for the tip!

[ Parent | on HN ]

Re:WebGPU GPT Model Demo by DustinBrett on Friday April 21, 2023 @12:36AM (#35649847)

Np! Although there may still be some special WebGPU features in v113 that make v94-112 less ideal.

[ Parent | on HN ]

Re:WebGPU GPT Model Demo by DustinBrett on Saturday April 22, 2023 @03:05AM (#35664081)

I actually just tried this on my own domain and although it enabled WebGPU it had another error, which was:

"Find an error initializing the WebGPU device Error: Cannot initialize runtime because of requested maxBufferSize exceeds limit. requested=1024MB, limit=256MB. This error may be caused by an older version of the browser (e.g. Chrome 112). You can try to upgrade your browser to Chrome 113 or later."

[ Parent | on HN ]