Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Mistral 7B,The complete Guide of the Best 7B model. Parent comment
https://github.com/PygmalionAI/aphrodite-engine https://github.com/LostRuins/koboldcpp
Picking a model to host is quite a rabbit hole, but I am very interested in SciPhi and Zephyr at the moment.
I havent messed with Petals yet either, but swarm finetuning is very appealing... If thats even implemented atm.
There are no comments on this comment yet.
https://github.com/PygmalionAI/aphrodite-engine https://github.com/LostRuins/koboldcpp
Picking a model to host is quite a rabbit hole, but I am very interested in SciPhi and Zephyr at the moment.
I havent messed with Petals yet either, but swarm finetuning is very appealing... If thats even implemented atm.