I'm at the hairy edges of my understanding here as well, but AFAIK infinite-dimensional Hilbert spaces arise when modeling position-momentum states because it is assumed that space is continuous.