News for hackers. Stuff that matters.

A comment on The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT. Parent comment

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by alfor on Sunday April 09, 2023 @08:31PM (#35507853)
Thanks, so to make usable you would need a GPU with at least 50GB. That probably mean A100 with 80GB at around 10K$.

Ok I understand why people use CPU and main memory.

After a quick check up you can rent a A100/80G at 1$-2$/h.

[ Parent | on HN ]

There are no comments on this comment yet.