Making AMD GPUs competitive for LLM inference

Re:Making AMD GPUs competitive for LLM inference by currymj on Thursday August 10, 2023 @09:57AM (#37076224)

i mean in AI specifically, you need your stuff to be usable by a small lab of prof/grad students, otherwise it will never get adoption.

usually at least some of the compute resources are "prosumer" workstations using commercial cards.

[ Parent | on HN ]

Re:Making AMD GPUs competitive for LLM inference by latchkey on Thursday August 10, 2023 @11:04AM (#37077075)

Agreed, AMD needs to get their high end cards into more schools. Short of that, they need a place where people can rent them by the hour (and give discounts to schools).

[ Parent | on HN ]