Re:Ask HN: Cheapest hardware to run Llama 2 70B
by leonletto on Wednesday August 09, 2023 @09:04PM
(#37070525)
We bought an A6000 48GB ( as mentioned by someone else ) and it’s works great for $3800. The power requirements are modest as well compared to consumer GPU’s. We looked at the ADA version but even used they are a lot more and your buying speed not usability. I would rather buy another A6000 and have 96GB of ram to fine tune with. That’s just me though and everyone needs to rank their needs against what they can afford.
[ Parent
| on HN ]
There are no comments on this comment yet.