News for hackers. Stuff that matters.
Re:Ask HN: Cheapest hardware to run Llama 2 70B by quickthrower2 on Thursday August 10, 2023 @01:15AM (#37072234)
Vastai would rent you those for about $.50 an hour so gives you an idea of what it costs. Assuming the GPUs memory can be stacked

There are no comments on this comment yet.