Yes, that is exactly the case and you've understood the issue perfectly. I wouldn't go so far as to say first-class functions must have a garbage collector to work, but I would say that they are so dependent that this would really be a bold area of computer science research.
That is, it seems to me that the essential feature that makes this work is garbage collection (and that all local variables are references to values that will live until garbage collection). Do I have that right?