News for hackers. Stuff that matters.
Re:Ask HN: Cheapest hardware to run Llama 2 70B by leonletto on Wednesday August 09, 2023 @09:04PM (#37070525)
We bought an A6000 48GB ( as mentioned by someone else ) and it’s works great for $3800. The power requirements are modest as well compared to consumer GPU’s. We looked at the ADA version but even used they are a lot more and your buying speed not usability. I would rather buy another A6000 and have 96GB of ram to fine tune with. That’s just me though and everyone needs to rank their needs against what they can afford.

There are no comments on this comment yet.