We recently added support for local document chat in RecurseChat (https://recurse.chat), including chatting with PDFs and markdown. You can see a demo here: https://twitter.com/chxy/status/1777234458372116865

RAG happens all locally (local embedding model and local vector db).

The app is secured by Mac App Sandbox, meaning it only have access to your selected file in the system dialog or drag and dropped files. If you use a local LLM, everything works offline.