News for hackers. Stuff that matters.
Re:Microsoft’s Kate Crawford: ‘AI is neither artificial nor ... by bitcurious on Monday June 07, 2021 @10:09AM (#27422800)
> AI is not detecting any kind of conceptual association. It is merely recording co-occurance.

Can you explain the famous example of “king - man + woman = queen” through this perspective? Naively it does seem to extend beyond statistical representation as it seems some semantic association is preserved through the mapping of language onto a vector space.

Re:Microsoft’s Kate Crawford: ‘AI is neither artificial nor ... by mjburgess on Monday June 07, 2021 @11:47AM (#27423946)
Well, it's essentially a coincidence mixed in with a bit of superstition.

K - M has no semantics, its more like something you'd find in a teen magazine. "K - M" means as much, "Prince" or "Jesus Christ" or any of a number of words.

The type of association underlying word vectors is just expecting to co-occur.

So there are many cases we can enumerate where our expectation that Q occurs is modulated by M occurring. So if M hasn't occurred in some text, we expect Q rather than K.

(Equally, in biblical literature, we might expect JC to occur; and in disney films, "prince").

And many of these famous examples are just tricks. Very nearly all of the industry sells this technology based on a few cases which happen to turn out "as a lay audience would expect", and neglect to include the many many cases where they do not.

And to be clear, we should not expect "K - M" to be "Q" in anything other than a basically statistical sense, relative to some texts. "King - Man" isn't a semantic operation.