pobonin
Show HN: verbatimeter - check how grounded your LLM / RAG agent is in real-time
https://pypi.org/project/verbatimeter/
I developed this tool and tried to keep it minimalist, lightweight, portable and easy to use. Hoping some people will find it useful. I think it's especially valuable for RAG agent but could be used more broadly as well.https://github.com/pierreolivierbonin/verbatimeter
Any plan to have multilingual support? Would love a French version.
Most of all, Neovim is helping me keep an eye on the code I develop at all times, and helping me keep writing code manually as well. It think it's especially important to be mindful about what we're doing these days because we're at risk of all becoming vibe coders as the AI assistants improve.
In essence, this is how: hjkl, G, gg, $, 0, w, b, e, i, y, p, <leader>e, <leader>o, <leader>ff, <leader>fw, /, dd, dw, grr, ]b, [b, :w, :q, :wq, etc... :)
What I'd like to see personally is Small Language Models giving similar performance eventually (because do we really need that many hundred billion parameters?). Researchers have shown that a lot of attention heads in the LLMs we're using these days are barely even active, so the MoE architecture seems like a step in the right direction. I still wonder how far we can push things back towards a 1B or 3B parameters model while trying to reach similar performances as double-digit or triple-digit B params models.