News for hackers. Stuff that matters.
Re:Ask HN: Are you comfortable uploading sensitive data to C... by kingstnap on Monday August 18, 2025 @10:26AM (#44941014)
I can and have when I was required to. It was slow and had worse results than I had hoped. Probably because I dont have enough VRAM for the big open source models so I was using 8b ones.

I left this bit out because my original comment was getting long but I think it's important to be respectful over others' privacy wishes. So I didn't use an API when it concerns other people.

Re:Ask HN: Are you comfortable uploading sensitive data to C... by tygra on Monday August 18, 2025 @11:07AM (#44941473)
Nice.

Of course, you need decent hardware to run LLMs locally, but you don’t need a super high-end computer to host qwen3:30b or gpt-oss:20b. You don’t even need a GPU for those models, as long as you’ve got a modern CPU. And they’re already pretty solid for writing and coding.