Probably fine and less vulnerable in situations like simply trying to get a few km over a wall on flat ground. Far more complicated over terrain and trying to fly low.

Off-the-shelf open source consumer drone flight controllers already have enough sensors to achieve what you suggest.