Re:Ghent University Vocabulary Test
by sbirch on Thursday June 26, 2014 @11:41AM
(#7950188)
I enjoyed reading some of their results. I see some methodological issues here, however:
1) The test makes you distinguish between real words and a set of words they've made up in some way. As others have pointed out, some of them are pretty obvious non-words. I would expect the results to change depending on the method used to generate non-words.
2) Measuring the performance of a binary classification is a well studied problem with many metrics and approaches to quantifying performance (http://en.m.wikipedia.org/wiki/Binary_classification#Evaluat...). Subtracting the false positive rate from the true positive rate is not among them. The final score is not a consistent estimator of the fraction of words in their corpus you know.
Re:Ghent University Vocabulary Test
by ForHackernews on Thursday June 26, 2014 @11:50AM
(#7950226)
A lot of these were strange formations of regular words.
For example, I said I didn't know "symphonize and "discussible" because I have never ever seen either form used anywhere. But obviously, I know the words "symphony" and "discuss" so I can infer their meaning from the suffixes.
Re:Ghent University Vocabulary Test
by josephlord on Thursday June 26, 2014 @11:42AM
(#7950196)
I tried to only answer yes when I knew what the words meant rather than guessing. I also said "bubba", "bumf" and "nonsuccess" weren't words which it disagreed with.
Most of the other things that I didn't get were from biology. "lymphoid" (guessed it might have been a word but hadn't heard it so entered no), "dabchick" etc.
"bubba" and "bumf" are interesting ones as they ask the question of where the language ends and local dialects and slang begin (or are local dialects and slang within the language in which case an exhaustive list is impossible).
Re:Ghent University Vocabulary Test
by jameshart on Thursday June 26, 2014 @12:53PM
(#7950497)
Interesting, for me, to see 'bumf', because even though I recognize the word from my English dialect (Southern UK, originally), I'd mark that form as a nonword because I feel it's spelled wrong: I would write it 'bumph'. I have no idea why I would feel so strongly about that, though, because I can't imagine it's a word I've written or seen written down particularly frequently...
Re:Ghent University Vocabulary Test
by sosuke on Thursday June 26, 2014 @11:09AM
(#7950016)
The non-words threw me off the first time because I wasn't expecting them to be there. By the end of the test I felt like I didn't know enough English; scored 89%.
Re:Ghent University Vocabulary Test
by fchollet on Thursday June 26, 2014 @10:11AM
(#7949690)
Non native, 81%. I think the test might be easier for non-natives speaking european native languages, as they cumulate etymological understanding from several languages.
Re:Ghent University Vocabulary Test
by jonnathanson on Thursday June 26, 2014 @10:43AM
(#7949871)
I'd also guess that non-native speakers are less likely to say "yes" to fake words. Non-native speakers are, presumably, more self-aware of the extents and limitations of their English vocabularies. Native speakers seem more likely to succumb to issues of vanity, overconfidence, or bet-hedging on this sort of test.
Re:Ghent University Vocabulary Test
by reedlaw on Thursday June 26, 2014 @11:00AM
(#7949960)
The non-words are pretty easy to spot. On my first try I marked any word I was uncertain of as a non-word. I got a 75% with zero false positives. I looked at all the words that I marked as non-words and saw that most of them I had suspected were real words. Then I tried it again with an increased confidence and got 90% with zero false positives.
Re:Ghent University Vocabulary Test
by Patrick_Devine on Thursday June 26, 2014 @03:00PM
(#7951067)
Native speaker and did 77% and 94% the first and second times respectively. My favourite "non-words" though would have to be "meedcave" and "cunstalize". I'm not quite sure what "cunstalize" would mean, but I feel like I desperately need a meedcave.
Re:Ghent University Vocabulary Test
by super_mario on Thursday June 26, 2014 @11:31AM
(#7950154)
Non-native speaker, got 93%. But English is almost like my first language. I haven't spoken anything else for decades, even though I speak 3 other languages, and think, dream and express myself best in English.
Re:Ghent University Vocabulary Test
by fecund on Thursday June 26, 2014 @10:50AM
(#7949909)
It seems I know 90% of English language words and it is extremely unlikely that I know that many. I believe the numbers are off by a large margin. I would love to look how they arrive at those estimates.
Re:Ghent University Vocabulary Test
by impy on Thursday June 26, 2014 @10:32AM
(#7949808)
Non Native: 69%. Took Iter as a non word. Been using that too much as a name in programming I guess. Been too trigger happy on the 'f' key with a few words I did know though.
Re:Ghent University Vocabulary Test
by pc86 on Thursday June 26, 2014 @10:24AM
(#7949754)
Yes given the admonishment about "heavy penalties" at the beginning I hit no on any word I was on the fence about (and accidentally when I got to "triennially"). 71% as a native speaker.
Re:Ghent University Vocabulary Test
by anathebealio on Thursday June 26, 2014 @11:26AM
(#7950121)
I wish they had the statistics available for people who complete the test. It would be interesting to look at how native speakers and non native speakers differ.
Re:Ghent University Vocabulary Test
by coriny on Thursday June 26, 2014 @10:11AM
(#7949694)
OK, I failed this test before I even got to it. Apparently you are only allowed to put one country in the "Where did you grow up in?" question. I don't know why they aren't interested in the verbal abilities of the large number of people whose parents weren't sedentary - e.g. military, mining industry, diplomats, aid, disaster, mega-construction etc etc.
/whine over.
EDIT: Also, no way to communicate this flaw to them (I'm not on Twitter).
Re:Ghent University Vocabulary Test
by coriny on Thursday June 26, 2014 @11:10AM
(#7950031)
True. I could also walk over to the place and tell them in person (after a flight and a drive etc). My thoughts are that if you are asking people to volunteer to contribute, expecting people to sign up to a third party in order to communicate is not "frictionless". After all, there is thing called email that's been around for a while and is used by, pretty much, everyone. Also post forms. The main reason for using Twitter (my belief) is to get your users to promote you for free.
Re:Ghent University Vocabulary Test
by coriny on Thursday June 26, 2014 @11:06AM
(#7949999)
Which is a terrible excuse for putting a fundamental flaw into the analysis. It's building a big assumption into the model that's known not to hold true in reality. Especially as the mis-represented cohort will, linguistically, be one of the most interesting - likely above average intelligence and a very different exposure to language. I suspect personally it's an oversight.
EDIT: Or, as is dawning on me, I might have missed a bit of sarcasm?
1) The test makes you distinguish between real words and a set of words they've made up in some way. As others have pointed out, some of them are pretty obvious non-words. I would expect the results to change depending on the method used to generate non-words.
2) Measuring the performance of a binary classification is a well studied problem with many metrics and approaches to quantifying performance (http://en.m.wikipedia.org/wiki/Binary_classification#Evaluat...). Subtracting the false positive rate from the true positive rate is not among them. The final score is not a consistent estimator of the fraction of words in their corpus you know.
For example, I said I didn't know "symphonize and "discussible" because I have never ever seen either form used anywhere. But obviously, I know the words "symphony" and "discuss" so I can infer their meaning from the suffixes.
Most of the other things that I didn't get were from biology. "lymphoid" (guessed it might have been a word but hadn't heard it so entered no), "dabchick" etc.
"bubba" and "bumf" are interesting ones as they ask the question of where the language ends and local dialects and slang begin (or are local dialects and slang within the language in which case an exhaustive list is impossible).
accurse, glycol, propitiation, tumescence, landlocked, klystron, squab, blithesome, lacertian, dingbat, gradate, adjudge, microsomal, latescence, intercut, aviary, semis, vie, dollarfish
But given that Shakespeare wrote all his books with about 1k5 words this test doesn't proof much :)
Missed: rood, ceil, catchfly, slickens, tuberculation
Some of those non-words were gorgeous: costyhibbles, neatherden, quiffiness, concodion
> The non words were gems, blurishness... why did I say yes to that?
Try reading that as:
> The non words were gems. Blurishness... why did I say yes to that?
EDIT: and 0 non-words
Leaned on the side of `no`: 0 non word yesses at least.
/whine over.
EDIT: Also, no way to communicate this flaw to them (I'm not on Twitter).
EDIT: Or, as is dawning on me, I might have missed a bit of sarcasm?