News for hackers. Stuff that matters.

A comment on Show HN: Khoj – Chat Offline with Your Second Brain Using Llama 2. Parent comment

Re:Show HN: Khoj – Chat Offline with Your Second Brain Using... by ramesh31 on Sunday July 30, 2023 @04:45PM (#36935775)
>Or at least models that don’t hog so much RAM

The RAM usage is kind of the point though; we're trading space for time. It's not a problem that the model is using it, it's just that with the default choice for UI being web based now, the unnecessary memory usage of browsers is actually starting to be a real pain point.

[ Parent | on HN ]
Re:Show HN: Khoj – Chat Offline with Your Second Brain Using... by 110 on Sunday July 30, 2023 @06:05PM (#36936476)
1. I hear you on going back to lightweight native apps. Unfortunately the Python ecosystem is not great for this. We use pyinstaller to create the native desktop app but it's a pain to manage.

2. The web UI isn't required if you use Obsidian or Emacs. That's just a convenient, generic interface that everyone can use.

[ Parent | on HN ]