True but memory requirements grow with sequence length. For recurrent models the memory requirement is constant. This is why I qualified with "low memory".