You’d have to define what you mean by “existence” here. Clearly, there are infinite sets we can represent with a finite sequence of symbols. We can also imagine and reason about alternative universes with an infinite amount of information. You’d have to argue about how doing so would somehow be an incorrect thing to do.