There are definitely major challenges, although maybe those could work in areas where the motion is slow but constrained (e.g., a cart to move cars in/out/around a dedicated parking lot). Maybe flatten the surface used for normal motion and use sides for infrequent, slow maneuvers. I do not know.

But those ideas are tangential (being generous) to self-driving, so better not steal cycles from it.