As an example, suppose I'm Tivo. I make this cool DVR using the Linux kernel. It contains modifications to the kernel, a new filesystem, etc. Suppose also that you purchase the DVR, which comes only with a pre-built binary. Under the GPL, you also have a right to get the source code used to make the binary, and in a usable form. Which is why you can go to the Tivo site and download the source for your hardware.
Reverse engineering might get you the effective equivalent, after a lot of work. Redistribution right doesn't give you the right to source code.
The GPLv3 also uses copyright to require licensing of patent rights.
Do you not need these rights? Do you think others might find those rights useful?
See http://fsfe.org/campaigns/gplv3/patents-and-gplv3.en.html for a long discussion.
The "bright line" isn't always so bright. Consider if a hardware company pays MPEG LA for an MPEG license in order to sell a piece of video hardware based on Linux. The hardware company didn't get the patent, so while they must release the OS source under the GPL, they don't have the right to sublicense.