And how would you solve the compression problem of dealing with all that data? Our brains are running a similar algorithm to mpeg-4 where we discard redundant data and make some basic predictions about movement. If they didn’t we’d waste a lot of time paying attention to unimportant things in our visual field.

Those are not necessarily unimportant things. These are just things we don't have a capacity to notice because of crap hardware we have to process this information. We don't conciously process 2% of what we see because only 2% is relevant. We do that because hardware needed to process more wouldn't pass through birth canal.

The 2% off visual data that we process is essentially just the stuff that is changing. It’s not some secret hidden knowledge, we can still intentionally examine things closely and see all there is to see.

How many dots are in this image?: https://pbs.twimg.com/media/CsG6MSpWAAAdTob?format=jpg&name=...

After you give up counting them, here is an explanation: https://www.sciencealert.com/here-s-why-you-can-t-see-all-12...