According to Pew, the non-voter block is much less white, less educated, and poorer than the voting population. You can probably make several cases for which way that block breaks, but I would certainly not say they would vote proportionally the same as voters.
And the assumption that people who choose to vote have an equal distribution of political views to those who choose not to vote is ludicrous; people who, if they voted, would only vote for someone who isn't a major party candidate are going to be vastly overrepresented among nonvoters simply because they are more likely to feel participation is futile; it would be less inaccurate than assuming equal distribution—but still inaccurate—to assume every eligible nonvoter is equivalent to a vote against at least all of the major party candidates.