News for hackers. Stuff that matters.

A comment on NVIDIA introduces TensorRT-LLM for accelerating LLM inference on H100/A100 GPUs. Parent comment

Re:NVIDIA introduces TensorRT-LLM for accelerating LLM infer... by visarga on Friday September 08, 2023 @07:03PM (#37440366)
The code is known, nothing special. Just the weights are missing.
[ Parent | on HN ]

There are no comments on this comment yet.