It’s unbelievable because Gates is neither a biology exam author nor a biology textbook author, so how would he even know what‘s in the training set for AI?
It’s unbelievable because Gates is neither a biology exam author nor a biology textbook author, so how would he even know what’s in the training set for AI? To know, you would need to be an experienced biology teacher and survey the pedagogical literature.
When I was studying for AP Calculus or Literature etc I’m sure I could’ve made decent sample questions.
Coming up with such questions is not easy, and just because you did well on a test or "kept up with the field a bit" does not mean you can ASK such questions very well.
More like half of HNs believe they're near-experts in some random field.
To flip it around, I have friends who I would consider (hobbyist) experts in CS. The geneticist is much better at C++ and OOP than me, the geologist knows a lot about 3d modelling and the whole GIS world, and the economist knows way more about DS, AI and statistics. Who am I to say they aren't experts? This kind of rigid division of field and expertise made no sense in university, and it only breaks apart more as we get older and more experienced.
Heh, well, by coincidence, before I became a programmer I spent (too many) years as a PhD candidate in philosophy, and I'm skeptical about the extent to which undergraduates can be considered experts. ;-)
That was a long time ago, though, and despite my experience, I've undoubtedly fallen far behind the current work in the field.
I should hope so, after paying so much tuition!
> knowing more than high-school curriculum - which is the bar we're discussing
No, that's not the bar you were discussing. Originally you said "near-experts", but now you've lowered the bar way down.
Given his track record and the state of AI today, I know which one I find more likely.
I don’t think the author realizes that “AP” is an exam for American high schoolers. Gates is only claiming he made new test questions at a high school+ level that wouldn’t have been in the training set for AI. I don’t see how it’s so unbelievable he could do that.