News for hackers. Stuff that matters.
Re:Duplicate Word Finder by londons_explore on Sunday February 19, 2023 @04:01AM (#34855783)
Write "the the the the the the"

Result:. "No duplicate words found"

Re:Duplicate Word Finder by suddenclarity on Sunday February 19, 2023 @04:05AM (#34855801)
Seems reasonable that those types of words are eliminated for the purpose of the tool. Either by having a letter limit or by whitelisting them. Of course there will be duplicates of "the" and "and".
Re:Duplicate Word Finder by notRobot on Sunday February 19, 2023 @04:10AM (#34855819)
They're called "stop words".
Re:Duplicate Word Finder by oneeyedpigeon on Sunday February 19, 2023 @09:43AM (#34857949)
Unfortunately, it's just a letter limit; lower it and the "the"s get highlighted. Support for stop/common words would definitely be a good upgrade.
Re:Duplicate Word Finder by londons_explore on Sunday February 19, 2023 @04:03AM (#34855790)
Perhaps a better model might be to look at word frequency analysis, and highlight words that are used substantially more frequently than in typical English text.
Re:Duplicate Word Finder by finnhvman on Sunday February 19, 2023 @04:13AM (#34855838)
you can use the first slider on the toolbar to set the minimum word length, default is 4 (or the third button on the toolbar if you're on phone or smaller screens)
Re:Duplicate Word Finder by coffeeri on Sunday February 19, 2023 @04:06AM (#34855804)
You might have to adjust the minimal word length to 3.
Re:Duplicate Word Finder by dkarbayev on Sunday February 19, 2023 @10:58AM (#34858646)
Tried “Buffalo buffalo Buffalo buffalo buffalo buffalo Buffalo buffalo” and it highlighted every word. Tried “James while John had had had had had had had had had had had a better effect on the teacher” and it had no issues with it.
Re:Duplicate Word Finder by finnhvman on Sunday February 19, 2023 @11:42AM (#34859137)
you can use the first slider on the toolbar to set the minimum word length, default is 4 (or the third button on the toolbar if you're on phone or smaller screens)