You lose the voting rights as well. Users on brokerages typically agree to this when signing up. Some have opt outs but you may lose features being subsidized by the brokerage having the ability to lend shares.