No need to use some elaborate AI solution for such a simple (and long-time solved) problem.
In the case where someone asked your exact precise question including follow-ups, you get the same (or better) results from search.
In most cases for a small project, no one has answered your precise question, so you might need to read docs and figure it out. It’s often much quicker to use an LLM here (though sometimes less accurate than the hypothetical matching search result).
As a benchmark, try using an LLM vs. search for answering questions about Nix. I find it to be 10-100x more efficient than searching and reading through the docs (including hallucinations and time spent corroborating, since usually I can validate the answer by running some command). This is perhaps a cherry-pick for LLMs, but it should illustrate clearly why “just use search” is missing the value prop completely.
The moment your question is more than 5 words long you can forget about it.
Aider can tailor the help response to exactly their question and situation. It also always links to relevant docs in these help responses.
I've pasted doc links in reply to user questions in discord, and I've pasted /help output. The latter is far more helpful, and includes the links as a bonus.
Here's an example of it in action: https://github.com/LibreTranslate/LibreTranslate/issues/632
It's been working pretty well.
That’s one reason I added interactive help [0] to aider. Users can type `/help <question>` in the app to get AI help, based on all of aider’s docs. I’ve been considering turning it into a bot for GitHub issues and discord.
Dosu [1] is another app in this “triage issues” space that looks really good when I encounter it in the wild.
[0] https://aider.chat/docs/troubleshooting/support.html
[1] https://dosu.dev/