Yes, this is what I'm asking. In direct marketing for example, there are ways that success can be scientifically measured. I am wondering if any of you have used more methodical approaches to improving applications -- or if it's just guess and find out if it worked 2 months from now.
The reason for this is that I just don't always trust users to think deeply enough of the problem for them to know what they want.
But don't lead them or demo anything; just watch how they start, and what they react to/don't understand.
We had a similar experience recently -- http://blog.seeksift.com/2007/03/02/an-epiphany/ -- and it did wonders for our usability.
Thanks, too, for bringing up the point about the blog; there are probably ways of customizing the header to point to SeekSift.com but I got a little frustrated with Wordpress after I found out you can't change their favicon.
I agree with jkush -- if you don't agree with the user, you should engage the user and see if you can get the feature to a common ground that you can agree with.
Also, if your feedback loop is just an email, maybe you should add a forum to make the loop more interactive.