Could you add the option to use the Shift key to select rows and columns, in addition to the mouse? In other words, using the cursor keys without Shift moves blocks, while pressing Shift moves a sort of 'cursor' (colored border?) to select rows/columns.

I'm not sure this would work well, might be slower then using the mouse, but maybe worth a try.