News for hackers. Stuff that matters.

A comment on NVIDIA introduces TensorRT-LLM for accelerating LLM inference on H100/A100 GPUs. Parent comment

Re:NVIDIA introduces TensorRT-LLM for accelerating LLM infer... by imjonse on Friday September 08, 2023 @06:29PM (#37440121)
From the article I understand it's only for H100? Both the title and the charts imply that.
[ Parent | on HN ]

There are no comments on this comment yet.