Because something might be inconvenient to you, it doesn't make it automatically wrong. There's a distinct line between free as in freedom and free as in arbitrariness. The former comes with responsibilities, the later without.
Furthermore take a look at the "USL v. BSDi" lawsuit, where BSD was sued by AT&T for infringing copyright-laws against their own(BSD) source-code, which was incorporated into USL(AT&T's) UNIX-variants!
"Freedom" comes with responsibility, if you want carefree "arbitrariness", then say so, but please don't mix them together, they are fundamentally different!
Furthermore they are not rights - they are desires.
You are free to negotiate terms with people from whom you obtain software, and you are free to refuse software without source code.
What the GPL seeks to do is force other people not to be free to choose their own terms.
Whether you like the effects of the GPL or not, it has nothing to do with freedom.