News for hackers. Stuff that matters.
Re:StupidFilter - Detect stupid text by aarongough on Friday November 13, 2009 @12:30PM (#940308)
From the FAQ:

  Do you really expect to be able to detect and 
  filter anything that's conceivably stupid?

    No, of course not. You'd need real AI for that, 
    and beyond a certain point it's simply subjective; 
    after all, a sufficiently advanced AI would probably 
    filter out the whole of human discourse, which 
    isn't the idea.
I have to admit that I laughed pretty hard when I read that...
Re:StupidFilter - Detect stupid text by onewland on Friday November 13, 2009 @12:42PM (#940341)
I think this is barfing on a lack of punctuation.

"this is the most shittest game online ever full of little nooby kids" (taken from a youtube comment) is "not likely stupid". Add a period at the end, though, and it works.

Maybe the parsing system isn't designed to handle incomplete sentences or sentence fragments? That could be difficult but key; many of the bottom of the barrel posts on the internet have no punctuation at all.

Update: Starting to really take an interest in this. While there are false negatives, I can't seem to find any false positives.

Re:StupidFilter - Detect stupid text by lsb on Friday November 13, 2009 @12:49PM (#940359)
Unrelatedly, one of the challenges in analyzing modern text with traditional NLP tools is that the tools usually expect standard English, whereas the text is rather colloquial, and the punctuation is for timing purposes, when present at all.
Re:StupidFilter - Detect stupid text by silent_tone on Friday November 13, 2009 @12:40PM (#940337)
This is sort of like a Youtube Snob for the rest of the internet. http://www.chrisfinke.com/addons/youtube-comment-snob/
Re:StupidFilter - Detect stupid text by tedunangst on Friday November 13, 2009 @12:49PM (#940358)
"How is babby formed?" -> Text is not likely to be stupid.

Incorrect.

Re:StupidFilter - Detect stupid text by jpeterson on Friday November 13, 2009 @01:30PM (#940476)
This looks stupid to you because you see it in the context of a stupid meme. When seen this way:

    How is <unknown word> formed?
It doesn't look stupid at all.
Re:StupidFilter - Detect stupid text by tedunangst on Friday November 13, 2009 @07:24PM (#941136)
A stupidity filter that doesn't block stupid memes is not a stupidity filter.
Re:StupidFilter - Detect stupid text by mahmud on Friday November 13, 2009 @01:09PM (#940421)
That question could be about the stages of fetus development, which is not an stupid thing to ponder.
Re:StupidFilter - Detect stupid text by RyanMcGreal on Friday November 13, 2009 @01:27PM (#940466)
They need to do way instain filter>
Re:StupidFilter - Detect stupid text by emmett on Friday November 13, 2009 @12:09PM (#940266)
Try submitting YouTube comments to the demo. This is shockingly accurate.
Re:StupidFilter - Detect stupid text by yan on Friday November 13, 2009 @12:55PM (#940372)
I think you just discovered its training dataset
Re:StupidFilter - Detect stupid text by jey on Friday November 13, 2009 @01:29PM (#940471)
Re:StupidFilter - Detect stupid text by Deestan on Friday November 13, 2009 @01:26PM (#940463)
Not surprisingly, 9 of the 10 YouTube comments I tested were classified as "likely to be stupid".
Re:StupidFilter - Detect stupid text by coderdude on Friday November 13, 2009 @12:29PM (#940301)
I can't get the thing to detect any stupidity whatsoever. I tried: -dude that was pretty funny lol -dude thats a funny one! lol -ur a ghey lord! All passed as not being likely to be stupid.
Re:StupidFilter - Detect stupid text by buro9 on Friday November 13, 2009 @12:32PM (#940315)
lmao!!!
Re:StupidFilter - Detect stupid text by RyanMcGreal on Friday November 13, 2009 @01:27PM (#940464)
>lmao!!!

Text is likely to be stupid.

Re:StupidFilter - Detect stupid text by Emore on Friday November 13, 2009 @01:43PM (#940506)
This is, apparently, not likely to be stupid:

Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.

Re:StupidFilter - Detect stupid text by eggoa on Friday November 13, 2009 @01:29PM (#940472)
I hope this doesn't end up equating having English as a second language with supidity.
Re:StupidFilter - Detect stupid text by NickM on Friday November 13, 2009 @05:03PM (#940927)
If something like this was actually used, I predict we would just see a shift from "I'm in ur base, killin ur doods" to "I am in your base, and I am in the process of killing your dudes."
Re:StupidFilter - Detect stupid text by pierrefar on Friday November 13, 2009 @01:10PM (#940423)
I posted "This is stupid" into the demo ( http://stupidfilter.org/demo.php ) and it said "Text is not likely to be stupid."
Re:StupidFilter - Detect stupid text by CulturalNgineer on Friday November 13, 2009 @07:15PM (#941131)
I put in "Goldman Sachs is crooked" as a query...and it returned:

"Text in not likely to be stupid"

Clearly this is a very perceptive algorithm!

Re:StupidFilter - Detect stupid text by hassy on Friday November 13, 2009 @12:27PM (#940298)
Anyone up for StupidGolf? :-)

My entry: "haha... lol" (11 chars)

Re:StupidFilter - Detect stupid text by erikwiffin on Friday November 13, 2009 @12:30PM (#940306)
I win.

"!" (1 char) is likely to be stupid.

Re:StupidFilter - Detect stupid text by sgk284 on Friday November 13, 2009 @01:28PM (#940469)
I feel like the bigger challenge is finding the smallest piece of text that isn't considered stupid. I hypothesized that this would be difficult, but it turns out 'a' isn't likely to be stupid.
Re:StupidFilter - Detect stupid text by hassy on Friday November 13, 2009 @12:36PM (#940326)
I tried single letters but didn't think of that.
Re:StupidFilter - Detect stupid text by onewland on Friday November 13, 2009 @12:39PM (#940336)
"o hai, sup?"

also 11

Re:StupidFilter - Detect stupid text by smallblacksun on Friday November 13, 2009 @01:18PM (#940443)
first! is classified as "not likely to be stupid", which shows how much work it needs.
Re:StupidFilter - Detect stupid text by tcskeptic on Friday November 13, 2009 @02:02PM (#940534)
It probably just indicates that they have not pointed it at Slashdot comments as a training set yet.