News for hackers. Stuff that matters.

ershad65

Re:A Practical Guide to Running Local LLMs on Tuesday March 11, 2025 @12:46PM (#43334362)
Built this https://www.caniusellm.com/ to check if you can run LLM in your local. You can provide custom config too

Show HN: I built a tool to check if your computer can run LLMs locally

https://www.caniusellm.com/

Built a simple web app that tells you which open-source LLMs will work on your hardware. It auto-detects your specs, shows compatible models from Hugging Face, gives realistic performance estimates (tokens/sec), and recommends quantization settings. You can also manually input specs to see "what if I upgraded my RAM?" Made this after wasting time downloading giant models only to find they...

( Read More... | 1 comment | 5 points | on HN )