News for hackers. Stuff that matters.
Re:Show HN: Open-source search engine with 2bn-page index by runarb on Tuesday September 13, 2016 @06:54AM (#12486924)
If you want you can use the now defunct web search engine boitho.com list of adult words. It is avalibal at https://github.com/searchdaimon/adult-words .

We mostly filtered out porn by using a two word phrase method. There were a lot of edge cases because many potentially dirty concepts are made up of words that are not bad when used alone. For example a text can have both "girls" and "nude" in it without being vulgar, but if it has the phrase "nude girls" the chance for it being pornografic is much higher.

There are no comments on this comment yet.