For reference, I, a computer science undergrad, learned this kind of sensor fusion theory in an elective class that was just an excuse for a soon to retire professor to play with lego robots

You can know more about sensor fusion than Elon does by reading a literal blog post.

The NN shouldn't have to "choose" one or the other. It's a classic "Not even wrong" question!