News for hackers. Stuff that matters.

A comment on Ask HN: Who is using small OS LLMs in production?. Parent comment

Re:Ask HN: Who is using small OS LLMs in production? by rimeice on Wednesday August 02, 2023 @10:09AM (#36971125)
Are you hosting that somewhere? If so, how much does that cost and do you have concurrent users?
[ Parent | on HN ]
Re:Ask HN: Who is using small OS LLMs in production? by ramesh31 on Wednesday August 02, 2023 @10:19AM (#36971259)
>Are you hosting that somewhere?

Tensordock. RTX4090 instances are ~$0.50/hr and can handle 3/4 concurrent users each.

[ Parent | on HN ]