GPLv2 requires that a copy of the license is distributed "with every copy of the program". [0]

[0]: http://www.gnu.org/licenses/old-licenses/gpl-2.0-faq.html#Wh...