News for hackers. Stuff that matters.

A comment on Deploy Gemma 7B with TensorRT-LLM and achieve > 500 tok/s.

Re:Deploy Gemma 7B with TensorRT-LLM and achieve > 500 tok/s by tulasichintha on Friday February 23, 2024 @01:35PM (#39484410)
Oh boy love it!
[ Parent | on HN ]

There are no comments on this comment yet.