How Is LLaMa.cpp Possible?

Re:How Is LLaMa.cpp Possible? by doctorpangloss on Tuesday August 15, 2023 @08:57PM (#37141430)

The servers the commenter is talking about are DGX machines from NVIDIA.

It doesn’t really make sense to BTO. What you gain economically you lose in the science you can do.

But nobody could have anticipated this.

[ Parent | on HN ]

Re:How Is LLaMa.cpp Possible? by _zoltan_ on Wednesday August 16, 2023 @04:57AM (#37144436)

you could also get HGX from any of the vendors.

[ Parent | on HN ]

Re:How Is LLaMa.cpp Possible? by bobboies on Wednesday August 16, 2023 @07:43AM (#37145580)

Wtf does HGX mean? God enough with the acronyms people.

Please take an extra ten seconds to speak in proper human language!

You could save on the worlds carbon footprint by reducing the number of times humans have to search for “what is NVIDIA hgx?” or is it “what is AMD HGX” and then subsequently visiting the websites to see if that’s right or not.

[ Parent | on HN ]

Re:How Is LLaMa.cpp Possible? by Vvector on Wednesday August 16, 2023 @10:08AM (#37147248)

What does Wft mean? God enough with the acronyms people. /s

[ Parent | on HN ]

Re:How Is LLaMa.cpp Possible? by bobboies on Wednesday August 16, 2023 @04:14PM (#37153077)

You got me there hahaha

However, there’s a difference between an acronym known to the broader public versus some single shot, context-specific one!

[ Parent | on HN ]