On the other hand thats what people(brain) do all the time.

Potentially explaining the disastrous results

Your brain takes decisions based on synthetically produced images? Then maybe you shouldn't drive on LSD ;)

The contents of your visual field exist precisely in your head and nowhere else. They are synthesized from limited sensory data. It so happens that your brain also generates the sensation of the content of your visual field being located in the world around you. These captured and resynthesized visual data happen to be mostly accurate but also wildly interpreted and altered, for instance the majestic and wondrous and inexplicable addition of the sensation of color.

Keyword: precisely

Your brain fills a lot of gaps, and your senses have a lot of noise, but it's still closer to reality than it isn't, particularly for the fovea.

Still, your brain doesn't make up what's behind a building violating our reliance on straight lines of light (unless you use sensorial "enhancement" drugs), or make up detailed images of what's in your peripheral vision (again, a known effect of many psychedelics), then presents it to you as truth, that's rather imagination and it uses a very different part of the brain, though connected to the visual cortex through the V1 area.

I'm sure it can have some uses (AI racing, anyone?), but most self-driving car decisions are ruled by what has been seen (signs/lights) and what can be seen, because that's how we arranged our streets and roads to be safe for us.

> your brain doesn't make up what's behind a building

The brain imagines something based on prior experience. Otherwise you'd be unable to navigate complex environments.