Show HN: Documind – Open-source AI tool to turn documents into structured data

Re:Show HN: Documind – Open-source AI tool to turn documents... by saharhash on Monday November 18, 2024 @05:37PM (#42177860)

Vision Language Model like Qwen VL https://github.com/QwenLM/Qwen2-VL or CoPali https://huggingface.co/blog/manu/colpali

[ Parent | on HN ]

Re:Show HN: Documind – Open-source AI tool to turn documents... by sidmo on Wednesday November 20, 2024 @11:59AM (#42195886)

VLMs are cool - they generate embeddings of the images themselves (as a collection of patches) and you can see query matching displayed as a heatmap over the document. Picks up text that OCR misses. Here's an open-source API demo I built if you want to try it out: https://github.com/DataFog/vlm-api

[ Parent | on HN ]