Sure, but you could come up with a license that's more specific, like "The Software shall not by used by any government agency or contractors for surveillance purposes" or whatever the equivalent legal speak is.

So, I can't use this computer vision library as part of my government program to prevent Rhino poaching in Africa?

You could if you asked the author and they agreed to give you a different license.

It's hardly free/open source software if you need to get a license from the author for each specific usage. Even MS treats their customers better than that.

You don't need a license for each specific usage. Most software doesn't involve surveillance, and most government surveillance software would probably not be an "exception" in the author's eyes. Rhino surveillance is an obscure edge case.