News for hackers. Stuff that matters.

A comment on Introduction to Decision Tree Learning.

Re:Introduction to Decision Tree Learning by kqr2 on Thursday April 26, 2018 @02:40PM (#16934408)
For the Information Gain calculations, why are the chocolates we don't want to eat (Blue & Kit Kats) discarded, i.e. considered entropy 0. Shouldn't it be included as part of the Information Gain formula?
[ Parent | on HN ]
Re:Introduction to Decision Tree Learning by ishansharma on Thursday April 26, 2018 @02:56PM (#16934530)
Since we are looking at entropy with respect to class (whether we want to eat or not eat), entropy for blue & kit kats is 0 as we don't want to eat them at all. So there's no randomness.

They are included in the IG formula but since they are multiplied by 0, they don't have any effect.

[ Parent | on HN ]