One of the attractions of the game is that the referee is the law; he makes a decision on his best judgement and that is the game.
I see your point; and it has merit. But I think it really detracts from the spirit, the flow and the attraction of the game :)
Already, I can't take the world cup seriously. 2006, it was the Italians diving to get free penalty kicks. Now, I can't even trust the refs to make honest calls. I'll continue to watch the games until something better comes along.
Are you talking about a particular incident of dishonesty? Refs tend to be impartial as they benefit from being impartial (wages, honour) whilst would lose by being noticeably partial (lost license to ref, no more wages).
The ref for the Slovenia/US game was banned from refing any future Worldcup matches and is being investigated by FIFA.