>Teaching them an abstract field without connections to what motivates it (intellectually or practically) is pedagogically not ideal.

While fair in general, the point is k means has nothing to do with linear algebra besides they both use numbers sometimes. It would be like sandwiching in a chapter on RSA crypto because it's interesting and number-y but still has no connection to linear algebra.