Not true.
The marginal cost of pretty much anything on a chip itself is close to zero. For example, most 3 core chips are actually 4 core chips with one disabled. Putting the extra silicon on the chip is effectively free.
The money goes in the investment in the factory and the R&D, NOT the raw materials or production costs.
If you need that silicon to actually work, then it's not free. Floor-sweeping is necessary because the more stuff you put on a chip, the more likely it is to have defects. That really is an extra cost. I don't think there is any way around that.
But I think you are overestimating how low-end these chips are. See http://arstechnica.com/gadgets/news/2008/02/small-wonder-ins... for example, which shows that the Silverthorne architecture (1st Gen Atom) has pretty much the same transistor count as a Pentium 4.
No one thought that the fact the Pentium 4 had to support x86 was a significant factor vs other architectures. For the chips we are talking about, the cache memory takes more transistors, so the quality thing is pretty insignificant too.
True - see also this:
http://codingrelic.geekhold.com/2010/08/x86-vs-arm-mobile-cp...
However, if x86 has neither a process or a compatibility advantage, then even a tiny technical disadvantage turns into a tiny extra cost, which can be important for high volume chips.