News for hackers. Stuff that matters.

A comment on Cheapest way to deploy smaller fine-tuned AI models?.

Re:Cheapest way to deploy smaller fine-tuned AI models? by ilaksh on Tuesday November 14, 2023 @10:38AM (#38264584)
If you're only using it incrementally then Replicate and Modal Labs have per-second pricing.

Not sure about HuggingFace though.

Sagemaker supposedly has a Serverless endpoint but haven't looked into it and doubt it would be a good deal since it's AWS.

[ Parent | on HN ]
Re:Cheapest way to deploy smaller fine-tuned AI models? by johhns4 on Tuesday November 14, 2023 @11:00AM (#38264932)
Looks like replicate is perfect. Will look into it. Thanks!
[ Parent | on HN ]