News for hackers. Stuff that matters.
Re:Accelerating Gemma 4: faster inference with multi-token p... by recsv-heredoc on Tuesday May 05, 2026 @01:37PM (#48025814)
CloudFlare offers excellent service for many of the open-weights models. It's fast, cheap and simple to set up. Can highly suggest as an LLM provider.

They serve gemma-4-26b-a4b-it.

Re:Accelerating Gemma 4: faster inference with multi-token p... by andruby on Tuesday May 05, 2026 @01:45PM (#48025929)
They do indeed. See https://developers.cloudflare.com/workers-ai/models/ They seem to allow some free usage without user account. Do they list limits anywhere?
Re:Accelerating Gemma 4: faster inference with multi-token p... by brikym on Tuesday May 05, 2026 @05:31PM (#48028881)
It doesn't seem that compelling to me. I can get the gpt-oss models cheaper from the openrouter nitro providers like groq and cerebras. The model you mention on Cloudflare infra is the same price through open router or directly.