> And basically all servers will have 8xA100
for those wondering: no this is not the norm. My lab at CMU doesn't own any A100s (we have A6000s).
Re:How Is LLaMa.cpp Possible?
by doctorpangloss on Tuesday August 15, 2023 @08:57PM
(#37141430)
The servers the commenter is talking about are DGX machines from NVIDIA.
It doesn’t really make sense to BTO. What you gain economically you lose in the science you can do.
But nobody could have anticipated this.
you could also get HGX from any of the vendors.
Wtf does HGX mean? God enough with the acronyms people.
Please take an extra ten seconds to speak in proper human language!
You could save on the worlds carbon footprint by reducing the number of times humans have to search for “what is NVIDIA hgx?” or is it “what is AMD HGX” and then subsequently visiting the websites to see if that’s right or not.
What does Wft mean? God enough with the acronyms people.
/s
You got me there hahaha
However, there’s a difference between an acronym known to the broader public versus some single shot, context-specific one!
who's norm? I assure you it's the norm. :)
> And basically all servers will have 8xA100 (maybe 4xA100). Nobody bothers with a single A100 (of course in a VM you might have access to only one)
wishing, or guessing something, without actual experience, doesn't make it true.
And basically all servers will have 8xA100 (maybe 4xA100). Nobody bothers with a single A100 (of course in a VM you might have access to only one)