Re:Serving AI from the Basement – 192GB of VRAM Setup
by bongodongobob on Sunday September 08, 2024 @04:28PM
(#41482935)
Yeah, because an M2 is in the same ballpark as 8 GPUs. Yes, you can use CPU now but it's not even close to this setup. This is hackernews. I know we're supposed to be nice and this isn't reddit, but comments like parent are ridiculous and for sure don't add to the discussion any more than mine do.
[ Parent
| on HN ]
Re:Serving AI from the Basement – 192GB of VRAM Setup
by TaylorAlexander on Sunday September 08, 2024 @08:30PM
(#41484457)
I simply didn’t know the answer and the response “it would be much slower” is a perfectly acceptable reply. I disagree that it was ridiculous to ask. I was curious and I wanted to know the answer and now I do. What is obvious to you is not obvious to other people, and you will get nowhere in life insulting people who are asking questions in good faith.