Abandoning Linux is definitely the wrong move, especially now that the gaming community is thriving.
Most people are using Windows or Mac and most of those are either completely ignorant, completely indifferent or actively hostile to Linux
This said, Linux is thriving a lot these days and is gaining a huge momentum as far as gaming goes. The community is constantly growing, the tools are all coming to Linux, SteamOS is right behind the corner, more and more companies are targeting the Linux platform, etc etc.
Bailing out of the Linux ecosystem now would be a terrible and shortsighted move on behalf of nVidia.
The only major project that's been canceled was Minecraft, which Luckey privately pointed out was complete and utter vaporware anyway. I have a DK1 and I can tell you that most "Rift projects" were one-off tech demos that mostly weren't maintained, and no one will miss. If OVR continues to develop a good product, people will continue to develop for their platform, whether Facebook owns them or not.
What PR damage, outside of the group that they expected would be unhappy? It's all over the head of people who didn't know what Oculus was before the acquisition. I don't think people who aren't part of the industry really care, because they don't know anything about it. To the extent that it was covered by mainstream outlets, it was because Facebook bought another company, not because they were outraged that the dream of Oculus VR was being destroyed by FB.
Fear hasn't replaced confidence in all consumers and developers. Logical persons may have their opinions and predictions, but no one is justified in anything beyond "wait and see" until something actually happens.
I'm not downplaying the impact of the ire of the gaming community. I just don't think there's been a noteworthy one other than the vast amount of fruitless rage that's filled tech forums recently. Perhaps we disagree, but I don't think my assertions are "plain stupidity".
If Nvidia dropped off the face of the Earth in Linux support everyone would just buy AMD discrete or Intel integrated parts and not bat an eye. And both of those companies have dozens or hundreds of developers working in the FOSS space. And for some reason, they also get my money, where I purposefully avoid Nvidia products (I don't buy their Tegra APUs, I'd never buy a computer with one of their graphics accelerators, etc).
For example, DOTA2 / Portal 2 / TF2 all run at ~60 fps with high / ultra settings on my 7870.
There is nothing about driver openness that would impede their ability to run OpenGL games besides the version support, and that is rapidly being remedied.
NVidia could also just not support Linux at all, which would certainly create even more of an uphill battle for Free graphics development and Linux.