News for hackers. Stuff that matters.

A comment on Show HN: Morphik – Open-source RAG that understands PDF images, runs locally. Parent comment

Re:Show HN: Morphik – Open-source RAG that understands PDF i... by hliyan on Tuesday April 22, 2025 @10:55PM (#43768262)
Wait, your title says this "runs locally"?
[ Parent | on HN ]
Re:Show HN: Morphik – Open-source RAG that understands PDF i... by ArnavAgrawal03 on Wednesday April 23, 2025 @11:18AM (#43773175)
Yes! If you're running the local version and it's taking long, that an indication that your GPU isn't being used properly. This can be traced back to the `colpali_embedding_model.py` file, where you can set the device and attention you want PyTorch to use.
[ Parent | on HN ]