Was thinking the same. Something like pointwise mutual information would do the trick.