News for hackers. Stuff that matters.
Re:Show HN: FastGraphRAG – Better RAG using good old PageRank by firejake308 on Tuesday November 19, 2024 @11:57AM (#42185565)
> fixing spelling and grammatical errors should involve humans in the process, so you really can't automate this

This is an interesting observation to me. I would have expected that, since LLMs evolved from autocomplete/autocorrect algorithms, correcting spelling mistakes would be one of their strong suits. Do you have examples of cases where they fail?

Re:Show HN: FastGraphRAG – Better RAG using good old PageRank by sdesol on Tuesday November 19, 2024 @12:09PM (#42185710)
If you look at my post history, you can see an example of how claude and openai can not tell that GitHub is spelled correctly. The end result won't make a difference but it raises questions regarding how else it can misinterpret things.

At this moment I would not trust AI to automatically make changes.

Re:Show HN: FastGraphRAG – Better RAG using good old PageRank by spdustin on Tuesday November 19, 2024 @03:10PM (#42187577)
My answer to this in my own pet project is to mask terms found by the NER pipeline from being corrected, replacing them with their entity type as a special token (e.g. [male person] or [commercial entity]). That alone dramatically improved grammar/spelling correction, especially because the grammatical "gist" of those masked words is preserved in the text presented to the LLM for "correction".