It is because RTO people would force WFH people to spend time (hours, in some case) commuting, spend money on lunch, and making the same salary. You are not wrong for that, but you can understand the reaction, at least, because you hated being forced to WFH during COVID