When you don't, the local files that haven't been accessed in some time are deleted and only a local alias is kept. Next time you need it, it'll be downloaded.