Any thought to integrate with Mechanical Turk? Some sites with lower visitor counts may not have the user base for this to work. I've written a Rails gem that makes Mechanical Turk integrations fairly trivial for Rails apps. (https://github.com/aantix/turkee) Hopefully this could help.