News for hackers. Stuff that matters.

A comment on Llama 2 on ONNX runs locally.

Re:Llama 2 on ONNX runs locally by hint23 on Friday August 11, 2023 @04:17AM (#37086320)
For best performance on x86 CPU and Nvidia GPU, ts_server is interesting ( https://bellard.org/ts_server ).
[ Parent | on HN ]

There are no comments on this comment yet.