What the parent says is take your argument for time not existing:
"If you say that you experience time. Well. That's how neural network works - they are shaped by events/impulses which happened to the network and accessing this information gives you illusion of a past - but this information encoded in your brain exists now."
By the same logic, matter doesn't exist either.
Our brains [1] perceive a material world, but it's only a as thoughts an impressions they do so. There doesn't need (nor do we have of there existing) an actual material world. A neural network as complex as our brain that gets the same weights and is fed the same events/impulses as raw information (e.g. digits of input) would see the same "material" world.
No more reason for the material world to exist, than there's for time.
In fact, perhaps it's just my own brain, alone, as perhaps I'm the only actual person in the universe. What proof do I have that anybody else is not a "non playing character"?
About Solipsism - for sure in the universe you're living in you're the only one, as your perception is unique. We all have our own universes of thoughts. There's no proof for the question, that's why you should accept such possibility.