News for hackers. Stuff that matters.
Re:Show HN: Floneum, a graph editor for local AI workflows by Tostino on Wednesday July 12, 2023 @11:00PM (#36704533)
Exllama is significantly faster if you can fit the whole model in VRAM.

There are no comments on this comment yet.