There are fees and process time to refinancing that acts as a disincentive to do so; and for several decades the fixed rate (by design) has been higher than what the variable rate incurs over the term (at least in Canada, where the term and the amortization period aren't the same).