Arbitrary here subtly includes infinite, since if it does not, then my argument is valid.
Modeling it as infinite does not make any more sense than modeling it is having 1 googol^googol^googol memory cells, clearly above the physical limit, and therefore any differences between the two models are artifacts irrelevant to anything human civilization will ever encounter.
Google search term: finitism.
To illustrate this fairly viscerally, a modern computer can access the internet and use an obscene amount of memory which will only go up in the future. We don't know how far up it will go, so modelling it as infinite makes sense.
Also, as another thought experiment, what if the universe is infinite? And what if it contains an infinite--or at least quickly expanding--amount of matter? Then a computer could effectively have infinite memory. Unfortunately, I really can't comment because I know even less about physics than I do about math :P.