News for hackers. Stuff that matters.
Re:Ask HN: What do you do with Local LLMs? by Tepix on Thursday April 11, 2024 @04:16PM (#40006379)
If you send yourself messages via a Discord bot, you lose the privacy advantage of running a LLM locally.

Discord does not have end-to-end encryption for messages.

Re:Ask HN: What do you do with Local LLMs? by haxel on Thursday April 11, 2024 @05:16PM (#40006901)
Indeed. Currently, my primary concerns are a) surprise b) accessibility c) efficiency and d) self-containment.

Surprise, because that draws my attention better. Not interested in guardrails here.

Accessibility, because I can involve my sons without friction.

Efficiency, because using Discord lets me skip building or finding a component (for now).

And I still get a degree of self-containment because Discord is the only piece I'll need to swap out. Bonus that it doesn't have a recurring cost until then.

Yet privacy still matters to me. Despite being Discord-compromised, the detailed personal context within the prompts remains private. The data that determines the timing and topic of each message remains private as well.