News for hackers. Stuff that matters.
Re:LM Studio is now an MCP Host by boredemployee on Wednesday June 25, 2025 @09:58PM (#44383574)
care to elaborate? i have rtx 4070 12gb vram + 64gb ram, i wonder what models I can run with it. Anything useful?
Re:LM Studio is now an MCP Host by nix0n on Thursday June 26, 2025 @10:50AM (#44388014)
LM Studio's model search is pretty good at showing what models will fit in your VRAM.

For my 16gb of VRAM, those models do not include anything that's good at coding, even when I provide the API documents via PDF upload (another thing that LM Studio makes easy).

So, not really, but LM Studio at least makes it easier to find that out.

Re:LM Studio is now an MCP Host by boredemployee on Thursday June 26, 2025 @02:27PM (#44389969)
ok, ty for the reply!
Re:LM Studio is now an MCP Host by Eupolemos on Saturday June 28, 2025 @10:55AM (#44405120)
If you go to huggingface.co, you can tell it what specs you have and when you go to a model, it'll show you what variations of that model are likely to run well.

So if you go to this[0] random model, on the right there is a list of quantifications based on bits, and those you can run will be shown in green.

[0] https://huggingface.co/unsloth/Mistral-Small-3.1-24B-Instruc...