Re:Introducing ChatGPT and Whisper APIs
by skybrian on Wednesday March 01, 2023 @03:00PM
(#34987479)
Stable Diffusion isn’t free if you include the cost of the machine. Maybe you already have the hardware for some other reason, though?
To compare total cost of ownership for a business, you need to compare using someone else’s service to running a similar service yourself. There’s no particular reason to assume OpenAI can’t do better at running a cloud service.
Maybe someday you can assume end users have the hardware to run this client side, but for now that would limit your audience.
Re:Introducing ChatGPT and Whisper APIs
by novaRom on Wednesday March 01, 2023 @05:32PM
(#34989266)
Ever heard about Federated Learning? This is the way it goes. Also, I do run training with no matrix multiplication, just 3-bit weights, addition in log space, slight accuracy degradation, but much faster CPU only training.
Re:Introducing ChatGPT and Whisper APIs
by skybrian on Wednesday March 01, 2023 @09:26PM
(#34991150)
Okay but I meant generating results, not training. If you're running Stable Diffusion, the weights are given, but it's not going to run on a random PC.
To compare total cost of ownership for a business, you need to compare using someone else’s service to running a similar service yourself. There’s no particular reason to assume OpenAI can’t do better at running a cloud service.
Maybe someday you can assume end users have the hardware to run this client side, but for now that would limit your audience.