News for hackers. Stuff that matters.

A comment on Deploy Gemma 7B with TensorRT-LLM and achieve > 500 tok/s.

Re:Deploy Gemma 7B with TensorRT-LLM and achieve > 500 tok/s by v1vek on Friday February 23, 2024 @05:26PM (#39486946)
This is great - taking scalability to the next level
[ Parent | on HN ]

There are no comments on this comment yet.