Re:GPT-4 Details Leaked
by Roark66 on Thursday July 13, 2023 @02:37AM
(#36705715)
I have and I am running it locally. Mostly in 7b variant which runs pretty much at chatgpt speed (when streaming) on my ryzen 3700 cpu + 32gb ram + 2xnvme in a mirror (it doesn't fit in the memory in its entirety, few gb go into the swap).
Of course to run it like that I have to be running nothing else. No xorg, no chromium etc. Just a pure linux console.
Of course to run it like that I have to be running nothing else. No xorg, no chromium etc. Just a pure linux console.
If you want to try falcon 40b instruct by yourself here I'd a public demo : https://huggingface.co/blog/falcon
Go to the bottom of the page.