LLaMA Now Goes Faster on CPUs

Re:LLaMA Now Goes Faster on CPUs by pelletier on Monday April 01, 2024 @07:25AM (#39892954)

This is probably what they are referring to https://github.com/jart/disaster

[ Parent | on HN ]

Re:LLaMA Now Goes Faster on CPUs by mijoharas on Monday April 01, 2024 @10:36AM (#39894586)

Thanks! I need to get better at googling I guess.

[ Parent | on HN ]

Re:LLaMA Now Goes Faster on CPUs by gpderetta on Monday April 01, 2024 @01:42PM (#39896815)

Nice. I have been using rmsbolt for a similar feature, but it is very rough. I'll need to give this as try.

[ Parent | on HN ]