Well, bosons also have mass and can distort space. Theoretically even the (rest-)massless photon distorts spacetime, think it's called a kugelblitz. Also how would fermions be the force carriers if they don't physically move through space themselves to interact with far away fermions, ex gravitational waves? Unless you're advocating for a relational model of space which hey I'm all for but introduces other issues afaik