News for hackers. Stuff that matters.
Re:Ask HN: Are you comfortable uploading sensitive data to C... by andreashaerter on Monday August 18, 2025 @08:49AM (#44939997)
Same for me. Big nope.

Investing quite a lot of time to figure out hosting LLMs locally in comparable quality without investing too much money (as smaller environments will never have a large budget for this).

Re:Ask HN: Are you comfortable uploading sensitive data to C... by tygra on Monday August 18, 2025 @11:02AM (#44941409)
Obviously you need decent hardware to run LLMs locally, but you don’t need a super high-end computer just to host qwen3:30b or gpt-oss:20b. Those models are already pretty solid for writing and coding.