News for hackers. Stuff that matters.
Re:Constellation, bringing AI to the Cloudflare stack by htrp on Monday May 15, 2023 @09:26AM (#35947787)
looks like this is cpu bound models only?
Re:Constellation, bringing AI to the Cloudflare stack by hades32 on Monday May 15, 2023 @04:14PM (#35953874)
No mention of the resources that are available? The most interesting models currently need beefy GPUs, but I don't think Cloudflare has those...
Re:Constellation, bringing AI to the Cloudflare stack by NicoJuicy on Monday May 15, 2023 @07:46PM (#35956081)
Some interesting examples, eg. The sentiment analysis in combination with email routing.

I'm curious about the models and GPU support too. I'm guessing this is currently beta and they are awaiting popularity of this.

The simple ( & cost-efficient) method would be to support CPU-first and then up the scale accordingly. No harm in that, but it could be made more clear regarding the roadmap.

Edit: during private beta there is support for <10 mb. Models.

https://developers.cloudflare.com/constellation/platform/dat...

Discussions @ https://discord.gg/cloudflaredev

Re:Constellation, bringing AI to the Cloudflare stack by SpaghettiX on Saturday May 20, 2023 @03:04AM (#36009961)
Its impossible to resize images or hash passwords on Cloudflare workers: the CPU time limit is too low.

I don't see how this makes Cloudflare interesting for AI. I suspect the same problems will exist.

This isn't so different than running onnx in a worker without constellation, and using KV directly?

The negative is it's such a closed ecosystem.

Re:Constellation, bringing AI to the Cloudflare stack by kentonv on Saturday May 20, 2023 @11:09AM (#36012547)
> Its impossible to resize images or hash passwords on Cloudflare workers: the CPU time limit is too low.

You're thinking of years ago when the CPU time limit was 50ms. These days the limit is 30 seconds, plenty of time for these tasks.

Re:Constellation, bringing AI to the Cloudflare stack by SpaghettiX on Sunday May 21, 2023 @03:18AM (#36018679)
Thanks for your reply.

I hit the CPU time limit a few months ago. I was paying for unbound and my account default was on. I guess I also hit the memory limit (128MB).

Perhaps we should reply on: https://community.cloudflare.com/t/long-running-webcrypto-ap... and https://community.cloudflare.com/t/options-for-password-hash.... Though I'm not sure if it will work, certain algorithms might take more than 128MB.

Re:Constellation, bringing AI to the Cloudflare stack by SpaghettiX on Sunday May 21, 2023 @03:21AM (#36018687)
Whilst you're here, when can we expect D1 to be distributed instead of a single instance, and when will D1's API to be stabilised?

Thanks :)

Edit: I just found https://blog.cloudflare.com/d1-turning-it-up-to-11/ so I'll read that first