That said there's probably little reason for you to turn down a less insubstantial offer for a name which generates you no revenue and presumably isn't integral to your development idea if you ever choose to pursue it.
I'd have thought that calling his bluff was the right response, along the lines of "I registered the domain X years prior to your decision to adopt a variant of that name for your own purposes. My development plans for this domain in $industry do not involve financial services in any way and thus no possibility of confusion with your financial services firm exists. Any move on your part to pursue this via UDRP would therefore almost certainly be a waste of your money and time. I have invested my own money and time in the domain and my development project for it, and have no intention of changing my business plans unless it is financially worthwhile for me to do so."
http://domainnamewire.com/2007/02/07/mgm-loses-bid-for-warga...
http://www.finnegan.com/publications/updatenewsletters/pubde...