Yes, you can imagine infinite recursion just as you can imagine an infinite 2d plane: infinity is good for a "woah dude", but adding infinity doesn't give you any structure and so it amounts to saying "imagine anything could happen".