News for hackers. Stuff that matters.
Re:Workers AI: serverless GPU-powered inference on Cloudflar... by claytonjy on Wednesday September 27, 2023 @11:08AM (#37675751)
I see plans for more models via HF partnership, but can I or will I be able to run a custom fine-tuned version of a supported model?
Re:Workers AI: serverless GPU-powered inference on Cloudflar... by celso on Wednesday September 27, 2023 @11:22AM (#37675985)
On top of our hosted and supported catalog of models, and the deploy to CF partnerships like the HF one, you will also be able to bring your own custom model at some point in time.
Re:Workers AI: serverless GPU-powered inference on Cloudflar... by claytonjy on Wednesday September 27, 2023 @11:50AM (#37676495)
Awesome. What about compiled model support? Running most of the listed models without compilation only makes sense for hobby projects.