Yes, and that mean an incandescent bulb is 100% efficient: all power used is converted to light+heat. But other systems can be more than 100% efficient - they can add more heat than the power they use. Or, in the case of central heating from waste, unused heat will probably have to be pumped off anyway, so using it is energetically free.
To increase efficiency, many cities run cogeneration plant, where the waste heat from electricity generation is piped into municipal heating system. In this scenario, the incandescent bulbs are wasteful way to heat the house, because it only uses 20-40% of the energy of the fuel, while municipal heating uses only waste energy to produce eletricity.
Yes.
> What is the other source of inefficiency that makes them inefficient for this by-use?
Heat pumps are more efficient at heating than resistive elements because they take advantage of already existing environmental heat, whereas resistive heating has to generate all of the heat directly.