News for hackers. Stuff that matters.

ahendest

Re:Local LLM for Private Companies on Thursday April 23, 2026 @07:24AM (#47874416)
how is your token/s for qwen and for flash-moe? and what system you are using? and do you satisfied on them? thanks for reply!!

Local LLM for Private Companies

what do you think to host a local LLM for company businness? ok we have ms365 subscription and built-in copilot for learn procedur, and Q/A. but to use the llm internal systems like special department softwares, which contains sensitive data, i do not have any idea other than local LLM. but so far what i found is gpus are expensive. gpt told me i can use 36B local LLM with rtx 6000 pro 96gb...

( Read More... | 2 comments | 2 points | on HN )