News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by sireat on Saturday April 01, 2023 @01:43PM (#35402261)
https://github.com/pyodide/pyodide is pretty amazing for running Python client side in the browser.

You could run notebooks entirely client side https://jupyterlite.readthedocs.io/en/latest/

The startup is slow but otherwise it is pretty functional.

There are no comments on this comment yet.