News for hackers. Stuff that matters.
Re:PruningRadixTrie – 1000x faster Radix trie for prefix sea... by jjice on Saturday September 30, 2023 @11:24AM (#37716316)
I also worked on a production auto complete feature for a web app a bit ago and I couldn't agree more with the quality sentiment. One or two characters is almost never enough to give a meaningful result. Using history or similar user search is much more effective than trying to guess what someone meant by "th".
Re:PruningRadixTrie – 1000x faster Radix trie for prefix sea... by Kalabasa on Saturday September 30, 2023 @11:43AM (#37716512)
How does that fare for non-English queries? E.g. are two chars still not enough for Chinese languages?
Re:PruningRadixTrie – 1000x faster Radix trie for prefix sea... by meepmorp on Saturday September 30, 2023 @12:17PM (#37716887)
I've seen 1.5 chars/token used as a rule of thumb for estimating token counts in Chinese text.
Re:PruningRadixTrie – 1000x faster Radix trie for prefix sea... by ComputerGuru on Saturday September 30, 2023 @02:04PM (#37718070)
> One or two characters is almost never enough to give a meaningful result.

TFA acknowledges that and mentions the exception:

While a prefix of length=1 is not very useful for the Latin alphabet, it does make sense for CJK languages