And no, I'm not kidding.
There is a broad market in specialist insurance which caters to the non-volume cases. It just costs more because you have to expend more effort-per-sale (and of course because non-volume also tends to mean that the risks genuinely are higher - e.g. homeowners with prior subsidence claims).
Of course if no one else is looking why give up the easy money - after all it is not like the customer can buy a new policy without the massive markup. Collusion does not need to be explicit, it can be accomplished just through everyone using the same systems and rules.
Competition only works if at least one of the parties involved is trying to compete. If all the insurance companies are happy to slap on a blanket risk premium then there is no competition. This is great if you want to disrupt the status quo.