"All ministers, whether senior and in the cabinet or junior ministers, must publicly support the policy of the government, regardless of any private reservations."
In a sense, UK actually has too much democracy, and too few [formal] checks and balances on the power of the elected legislature.
We don't know his private position any more, and it may have changed. But I think it's quite likely that his opinion hasn't changed; he just isn't allowed to state it publicly any more. In this case, it would be better for supporters of this position to keep him in the cabinet, where he can at least have a private influence. Consider this: if we could get everyone in the cabinet to share his opinion, we wouldn't have a problem any more. We need more David Davises in cabinet, not fewer.
The MPs to vote out are all the ones who are publicly in favour of the Snoopers' Charter. We can be far more confident in having an influence in our favour this way.
Although, I would concentrate on Theresa May herself (I considered doing this at the last election when all this was mooted but blocked by the lib dems, but I stood where I live instead.)
From this: David Davis: British 'intellectually lazy' about defending liberty
https://www.theguardian.com/politics/2015/nov/08/david-davis...
To this:
David Davis: Most public opponent of Theresa May’s snooping laws stops opposing them as soon as he enters cabinet
http://www.independent.co.uk/news/uk/politics/david-davis-mo...