News for hackers. Stuff that matters.
Re:The math and algorithms behind a search library by kbr on Saturday November 11, 2017 @01:02PM (#15677315)
This is how Wade was originally going to be implemented. I actually had a local version of it using an inverted index and a deterministic acyclic finite state automaton [1]. It was using TF-IDF as well for the rankings.

I began to experiment with a couple of my own ideas and used a trie rather than a DAFSA because it could be stored and loaded rather than generated at runtime. I also created and used the various linear methods described in the post to rank the documents.

[1] https://en.wikipedia.org/wiki/Deterministic_acyclic_finite_s...

Re:The math and algorithms behind a search library by mooneater on Saturday November 11, 2017 @08:05PM (#15679112)
Consider BM25 as a newer substitute for tf-idf https://en.wikipedia.org/wiki/Okapi_BM25