I get where you're coming from but the main thing in the story is that the aliens' perception of time was very different from that of humans; they could perceive their entire life at any given time. Given that, if the aliens could not imagine that humans only had this limited perception, the aliens would have thought the humans should already have known how their language worked...or something like that, miscommunication due to differences etc.