News for hackers. Stuff that matters.

A comment on Ask HN: How to get started with local language models?.

Re:Ask HN: How to get started with local language models? by PeterStuer on Sunday March 17, 2024 @08:52AM (#39734149)
You might want to start playing with with Ollama or LmStudio to get you started. The model's weights aren't normally inside your .exe . Typically you can address 128TB of virtual memory on Windows.

https://ollama.com/

https://lmstudio.ai/

[ Parent | on HN ]

There are no comments on this comment yet.