No, the copying is illegal as well. It's just that copying without redistribution is typically both hard to catch and not worth the copyright holder's attention.

At least, that's how it is in US law. Details at: http://www.copyright.gov/title17/92chap1.html#106