Ask HN: Where do you host your Llama 2 model?

Posted by ahmedmobin on Tuesday December 26, 2023 @10:56AM
from the ask-hn dept.

I'm currently hosting on AWS, but it's proving to be quite expensive, especially during the development phase. I'm actively exploring more cost-effective options as I'm concerned about the potential server costs once the project moves into production.

( 2 comments | 3 points | on HN )

Re:Ask HN: Where do you host your Llama 2 model? by palashkulsh on Tuesday December 26, 2023 @11:52PM (#38779206)

Hugging face maybe.

[ Parent | on HN ]

Re:Ask HN: Where do you host your Llama 2 model? by ahmedmobin on Wednesday December 27, 2023 @03:12AM (#38780055)

I am using hugginface. But it is not even suitable for staging.

[ Parent | on HN ]