I think one of the issues is you're never sure what someone is about to do. There is something about seeing someone take control of the drawing space where in VR your avatar would begin motioning towards the board or pickup the writing utensil.

Sometimes I'm hesitant to start scribbling on the drawing space because I don't have the social queues to not step on someone else's thoughts. Maybe this Whiteboard app solves that?