I don't think that taking the president and numerous government officials (who have little to gain by lying) at their word that Obama is a citizen is that much of a stretch of logic. If you think being called a racist for insisting that Obama is a foreign national is unwarranted, I'd ask when the last time you even considered such a thing about any president much less voiced it.
In the end, though, I firmly believe that Obama released this document for those in the center and center-right of the political spectrum, not for the hard-right who demanded to see it lest they initiate some kind of armchair revolution. Producing this document will not silence the far right, but the fact that it won't will push them further into the fringes in the view of mainstream Americans. They will appear unreasonable, unappeasable and extremist, all qualities that will slowly choke out their chances of claiming the White House.