News for hackers. Stuff that matters.
Re:Boston Housing Price Dataset was Removed from scikit-lear... by loeg on Friday December 30, 2022 @05:45PM (#34191019)
Close, but not exactly. One of its variables is how far its integration differs from 63% Black, squared.

I.e., you cannot distinguish a 73% black neighborhood from a 53% black neighborhood with this variable.

It's a bizarre variable and I guess I could see purging the column or at least suggesting it not be used, but I don't really understand why you'd delete the rest of the (sample) dataset on this basis.

Re:Boston Housing Price Dataset was Removed from scikit-lear... by josephcsible on Saturday December 31, 2022 @12:14AM (#34193811)
> Close, but not exactly. One of its variables is how far its integration differs from 63% Black, squared.

> I.e., you cannot distinguish a 73% black neighborhood from a 53% black neighborhood with this variable.

Isn't the point of that operation that a 1% black neighborhood and a 99% black neighborhood are both less integrated than a 50% black neighborhood? If you didn't do something like squaring, then wouldn't at least one of the former incorrectly register as more integrated than the latter?

> It's a bizarre variable and I guess I could see purging the column or at least suggesting it not be used, but I don't really understand why you'd delete the rest of the (sample) dataset on this basis.

Agreed.

Re:Boston Housing Price Dataset was Removed from scikit-lear... by loeg on Saturday December 31, 2022 @12:13PM (#34198423)
Yeah, I mean, I guess I'd suggest a raw Bk column to preserve the original data and maybe just absolute value of difference instead of square of difference.