News for hackers. Stuff that matters.

A comment on OpenLLaMA: An Open Reproduction of LLaMA. Parent comment

Re:OpenLLaMA: An Open Reproduction of LLaMA by pmoriarty on Wednesday May 03, 2023 @06:08AM (#35800309)
In case anyone's interested, on this page[1], a P4DE 24xlarge is listed as costing $25 per hour for a reserved instance.

[1] - https://instances.vantage.sh/

[ Parent | on HN ]
Re:OpenLLaMA: An Open Reproduction of LLaMA by akiselev on Wednesday May 03, 2023 @10:56AM (#35803155)
($25)*(24hours)*(30 days)*(12 months) = $216,000

That can't be right. That's basically the entire capital cost of an 8x A100 hyperplane from LambdaLabs [1] plus power for a year plus administration! What's the point of cloud hardware if you're paying for everything reserve anyway?

Roughly the same setup costs $12/hour at Lambda if you're lucky enough to snag one so it looks like demand for 8x A100 is so high that you basically have to pay AWS for an entire pod to get access to one, unless you want to pay $40 per hour (!!!)

[1] https://shop.lambdalabs.com/deep-learning/servers/hyperplane...

[ Parent | on HN ]