In other words the green faction is simply disinterested in nuclear fusion, like we are disinterested in the Large Hadron Collider, sure its a cool experiment, but nothing we should be considering to further our goal of fighting our current environmental disasters.
That said, I agree that as things stand today, fusion research is no panacea to climate change. However, note that the United Nations Framework Convention on Climate Change was ratified in '92, and if we'd decided to go all-in on fusion back then, who knows where we'd be at today...
So honestly I don’t believe that there exists people in the wild who’s opinion is: “No to fusion! Because nuclear = bad”, and if they do exists, I don’t think they are of anywhere near size and numbers required to influence public funding.
You cannot yet make money with it, so there's no capitalist lobby. Success is not certain, and timeframes are too long for politicians to score points in the election game. It's not as cool as space, and the green faction isn't too keen on the whole nuclear thing. So far, fears about peak oil turned out to be largely unfounded (but do note that we probably did pass the peak as far as conventional oil production in concerned).
If I kept at it, I probably could come up with more theories...