Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on GPT-4 API General Availability. Parent comment
I don't know anything so I left default settings.
I get about 450ms/t with airoboros-7b and 350ms/t with orca-mini-3b.
edit: with oobabooga webui
There are no comments on this comment yet.
I don't know anything so I left default settings.
I get about 450ms/t with airoboros-7b and 350ms/t with orca-mini-3b.
edit: with oobabooga webui