News for hackers. Stuff that matters.
Re:Workers AI Update: Stable Diffusion, Code Llama and Worke... by swazzy on Thursday November 23, 2023 @10:32AM (#38393820)
having a hard time calculating what the pricing is for this
Re:Workers AI Update: Stable Diffusion, Code Llama and Worke... by wirelesspotat on Thursday November 23, 2023 @11:45AM (#38394660)
Oddly, I don't see anything about pricing for Workers AI on the Workers pricing page[0] but their Workers AI blog post from Sept 2023[1] says the pricing is per 1k "neurons":

> Users will be able to choose from two ways to run Workers AI:

> Regular Twitch Neurons (RTN) - running wherever there's capacity at $0.01 / 1k neurons

> Fast Twitch Neurons (FTN) - running at nearest user location at $0.125 / 1k neurons

> Neurons are a way to measure AI output that always scales down to zero (if you get no usage, you will be charged for 0 neurons).

Here's the key detail:

> To give you a sense of what you can accomplish with a thousand neurons, you can: generate 130 LLM responses, 830 image classifications, or 1,250 embeddings.

[0] - https://developers.cloudflare.com/workers/platform/pricing

[1] - https://blog.cloudflare.com/workers-ai/

Re:Workers AI Update: Stable Diffusion, Code Llama and Worke... by tmikaeld on Thursday November 23, 2023 @10:58AM (#38394157)
Like with most serverless functions
Re:Workers AI Update: Stable Diffusion, Code Llama and Worke... by civilitty on Thursday November 23, 2023 @11:01AM (#38394197)
How many dollar bills does it take to make a pile worth sleeping in?
Re:Workers AI Update: Stable Diffusion, Code Llama and Worke... by MuffinFlavored on Thursday November 23, 2023 @10:59AM (#38394171)
having a hard time calculating why anybody needs this/wants this
Re:Workers AI Update: Stable Diffusion, Code Llama and Worke... by krosaen on Thursday November 23, 2023 @11:40AM (#38394606)
productionizing ai models is a pain, this makes it easy. say you were building a d&d app and wanted to generate character art, this would make it very easy to get started. aws has similar offerings (e.g sage maker) but it’s not on the edge.
Re:Workers AI Update: Stable Diffusion, Code Llama and Worke... by rafram on Thursday November 23, 2023 @11:40AM (#38394608)
It seems cheaper than the OpenAI API and is very easy to use from a worker.
Re:Workers AI Update: Stable Diffusion, Code Llama and Worke... by ushakov on Thursday November 23, 2023 @11:29AM (#38394494)
I see it more as a convenience feature for people already using CF Workers