News for hackers. Stuff that matters.
Re:UserTesting.com - 15 minute video of a user testing your ... by staunch on Friday November 21, 2008 @04:45PM (#372370)
I've used it and it is good. Highly recommended. The videos you get aren't super great quality but they're useful and the price is right. The only complaint I have is that I'm a tad jealous I didn't start this site.
Re:UserTesting.com - 15 minute video of a user testing your ... by jcl on Friday November 21, 2008 @05:15PM (#372393)
I wonder if one couldn't put together a software package that Mechanical Turk participants could use to generate similar (if lower-quality) data?
Re:UserTesting.com - 15 minute video of a user testing your ... by run4yourlives on Friday November 21, 2008 @05:23PM (#372401)
Why?

The main deliverable in user testing is quality. It's much better to have 5 detailed pieces of data than 100 that don't say anything at all.

Re:UserTesting.com - 15 minute video of a user testing your ... by jcl on Friday November 21, 2008 @06:20PM (#372473)
A smaller sample means a greater chance that it's not representative. If 10% of the population is colorblind (or left-handed, etc), you stand a greater-than-50% chance that a random group of five people won't identify a problem for this segment.

A larger number of available testers means more fresh eyeballs, hence a better chance of repeat queries yielding accurate first-impression data.

Feedback from people whose job it is to evaluate websites may not be representative of the average site visitor. They may be more familiar with common site layouts or have specific pet peeves.

Re:UserTesting.com - 15 minute video of a user testing your ... by iamwil on Saturday November 22, 2008 @07:52AM (#372919)
Probably depends on what you're looking for. When you're just starting out a site, just a couple users will point out all sorts of user interface weaknesses that'll keep you busy fixing for a long while.
Re:UserTesting.com - 15 minute video of a user testing your ... by tlrobinson on Saturday November 22, 2008 @12:54AM (#372762)
I think there's room for both. Turkers might simulate the casual browsers who happen upon your site. There could be valuable data buried in what they do in a short period of time.
Re:UserTesting.com - 15 minute video of a user testing your ... by raffi on Saturday November 22, 2008 @11:19PM (#373499)
FYI, I've already done this. I started the project last week and am still testing it (it works though). http://www.feedbackarmy.com/

Visit the site, give it your URL and some specifics to focus on, dump a credit card number into paypal, and subscribe to an RSS feed for the results.

Re:UserTesting.com - 15 minute video of a user testing your ... by jcl on Monday November 24, 2008 @09:31AM (#374836)
Ha, that's great. I was thinking more along the lines of a piece of software that runs alongside the Turker's browsing session and keeps track of what they see and what they do with the mouse cursor, perhaps augmented by a video of the user's face taken by webcam, if available. But even simple feedback -- as you have built -- is extremely useful.