Re:Ask HN: Are you comfortable uploading sensitive data to C...
by tygra on Monday August 18, 2025 @11:02AM
(#44941409)
Obviously you need decent hardware to run LLMs locally, but you don’t need a super high-end computer just to host qwen3:30b or gpt-oss:20b. Those models are already pretty solid for writing and coding.
Investing quite a lot of time to figure out hosting LLMs locally in comparable quality without investing too much money (as smaller environments will never have a large budget for this).