News for hackers. Stuff that matters.
Re:Right-sizes LLM models to your system's RAM, CPU, and GPU by fwipsy on Sunday March 01, 2026 @11:06PM (#47213770)
Personally I would have found a website where you enter your hardware specs more useful.
Re:Right-sizes LLM models to your system's RAM, CPU, and GPU by user_7832 on Sunday March 01, 2026 @11:58PM (#47214050)
Same, I opened HN on my phone and was hoping to get an idea before I booted my computer up.
Re:Right-sizes LLM models to your system's RAM, CPU, and GPU by greggsy on Sunday March 01, 2026 @11:44PM (#47213981)
I was hoping for the same thing.
Re:Right-sizes LLM models to your system's RAM, CPU, and GPU by HaloZero on Monday March 02, 2026 @12:39AM (#47214251)
Yeah, installing some script to get a command line tool doesn't seem worth it.
Re:Right-sizes LLM models to your system's RAM, CPU, and GPU by riidom on Monday March 02, 2026 @03:07PM (#47223378)
These 200 LOC install scripts turn me heavily off as well. But at least in this case, you can also just download the correct zip, extract the binary and do "./llmfit".
Re:Right-sizes LLM models to your system's RAM, CPU, and GPU by spockz on Monday March 02, 2026 @12:40AM (#47214256)
Hugging Face already has this. But you need to be logged in and add the hardware to your profile.
Re:Right-sizes LLM models to your system's RAM, CPU, and GPU by BloondAndDoom on Monday March 02, 2026 @12:56AM (#47214347)
Isn’t hugging face only shows it for the model you are looking for? Is there a page that actually HF suggests a model based on your HW?