News for hackers. Stuff that matters.
Re:Show HN: How we leapfrogged traditional vector based RAG ... by oshams on Friday July 19, 2024 @02:41PM (#41009689)
Thanks! It's a multi stage process where we summarize the code and structure it into articles. We also do some self verification, for example checking for dead links.
Re:Show HN: How we leapfrogged traditional vector based RAG ... by billmalarky on Friday July 19, 2024 @02:47PM (#41009743)
Do you build a syntax tree of the code, then loop the tree to auto-write an article for each node (or the larger or more material nodes) and then also reference the tree to pull in related nodes/pieces/modules/whatnot of the codebase when auto-writing a documentation article for each node?

This is fascinating thank you

Re:Show HN: How we leapfrogged traditional vector based RAG ... by oshams on Friday July 19, 2024 @02:52PM (#41009792)
yeah ! you know the best way to learn more is to join us, we're hiring: https://www.workatastartup.com/companies/mutable-ai
Re:Show HN: How we leapfrogged traditional vector based RAG ... by billmalarky on Friday July 19, 2024 @03:09PM (#41009963)
Greatly appreciate the suggestion! but I recently joined another YC backed Gen AI startup in the fine-tuning space (OpenPipe) :-D

Speaking of, there's a good chance fine tuned models will be a component of your fully-optimized codebase -> wiki automation process at some point in the future. Likely to increase consistency/reliability of LLM responses as clear patterns start to emerge in the process. If y'all decide to layer that on or even explore it as an optimization strategy hit us (or me directly) up. We love collaborating w/ engineers working on problems at the edge like this, aside from how engaging the problems themselves are, it also helps us build our best possible product too!

Very excited to follow your journey! just sent you a LI request.

Thanks again so much for sharing your wisdom!