Re:Ask HN: Best way to deploy an LLM for 100s of user
by clark-kent on Saturday July 06, 2024 @11:04PM
(#40894980)
If you are already on AWS, then it's better to run llama3 using AWS Bedrook. With Bedrock, you only pay for what you use instead of paying for an always-on EC2 instance.
[ Parent
| on HN ]
There are no comments on this comment yet.