Are local LLMs good enough now?

Posted by paramaggarwal on Sunday October 29, 2023 @03:34PM
from the medium.com dept.

( 1 comment | on HN )

Re:Are local LLMs good enough now? by paramaggarwal on Sunday October 29, 2023 @03:34PM (#38061832)

The new Zephyr 7B model can run locally on an M1 Pro MacBook as fast as ChatGPT is able to stream responses in the browser.

[ Parent | on HN ]