Re:Boston Housing Price Dataset was Removed from scikit-lear...
by josephcsible on Saturday December 31, 2022 @12:14AM
(#34193811)
> Close, but not exactly. One of its variables is how far its integration differs from 63% Black, squared.
> I.e., you cannot distinguish a 73% black neighborhood from a 53% black neighborhood with this variable.
Isn't the point of that operation that a 1% black neighborhood and a 99% black neighborhood are both less integrated than a 50% black neighborhood? If you didn't do something like squaring, then wouldn't at least one of the former incorrectly register as more integrated than the latter?
> It's a bizarre variable and I guess I could see purging the column or at least suggesting it not be used, but I don't really understand why you'd delete the rest of the (sample) dataset on this basis.
Re:Boston Housing Price Dataset was Removed from scikit-lear...
by loeg on Saturday December 31, 2022 @12:13PM
(#34198423)
Yeah, I mean, I guess I'd suggest a raw Bk column to preserve the original data and maybe just absolute value of difference instead of square of difference.
> I.e., you cannot distinguish a 73% black neighborhood from a 53% black neighborhood with this variable.
Isn't the point of that operation that a 1% black neighborhood and a 99% black neighborhood are both less integrated than a 50% black neighborhood? If you didn't do something like squaring, then wouldn't at least one of the former incorrectly register as more integrated than the latter?
> It's a bizarre variable and I guess I could see purging the column or at least suggesting it not be used, but I don't really understand why you'd delete the rest of the (sample) dataset on this basis.
Agreed.