News for hackers. Stuff that matters.
Re:Ask HN: How to get started with local language models? by instagib on Sunday March 17, 2024 @11:08AM (#39734941)
You can use webui https://github.com/oobabooga/text-generation-webui

Once you get a version up and running I make a copy before I update it as several times updates have broken my working version and caused headaches.

a decent explanation of parameters outside of reading archive papers: https://github.com/oobabooga/text-generation-webui/wiki/03-%...

a news ai website: https://www.emergentmind.com/

Reddit locallamma and how to prompt an llm: https://old.reddit.com/r/LocalLLaMA/comments/1atyxqz/better_...

Since you mention silly text generation there is also sillytavern which runs on top of another llm software such as webui. https://docs.sillytavern.app/

There are no comments on this comment yet.