At the risk of being pedantic (or misremembering college classes), there's more to it than that. First, at the relevant distance scales, the magnets aren't point particles, they have an extent and very close to that surface it should be 1/r. Secondly, magnets are dipoles and at greater distances the two poles cancel out to first order and you have a 1/r^4.