Re:LM Studio – Discover, download, and run local LLMs
by paul_n on Wednesday November 22, 2023 @01:09PM
(#38382773)
Actually, consider that the commenter may have helped un-obfuscate this world a little bit by saying that it is in fact easy. To be honest the hardest part about the local LLM scene is the absurd amount of jargon introduced - everything looks a bit more complex than it is. It’s really is easy with llama.cpp, someone even wrote a tutorial here: https://github.com/ggerganov/llama.cpp/discussions/2948 .
But yes, TheBloke tends to have conversions up very quickly as well and has made a name for himself for doing this (+more)
Like telling someone interested in 3D printing minis to build a 3D printer instead of buying one. Obviously that helps them get to their goal of printing minis faster right?