News for hackers. Stuff that matters.
Re:Why are there not more freelance testers out there? by cantlin on Thursday February 28, 2013 @09:25AM (#5298737)
We've needed a crowd-sourced human testing platform for software products for some time.

It would need granularity: as a developer I should be able to purchase N minutes of time from N people, potentially in such and such a demographic.

It would need an API: I should be able to build human testing into my deployment infrastructure.

It would need accountability: at minimum I want webcam footage of the tester using my product.

There are complications, but I see no reason why almost all of these couldn't be overcome by sufficiently smart automation.

Someone go build this!

Re:Why are there not more freelance testers out there? by anandkulkarni on Thursday February 28, 2013 @10:05AM (#5298921)
We actually do this at MobileWorks (mobileworks.com). There's an API that lets you get N minutes from N people filtered by demographic. Some folks use our Premier product for on-demand testing set up by email -- they send test requests to [email protected].

If you're looking for this more as a formal end-to-end service, you can take a look at our buddies at Rainforest (https://www.rainforestqa.com/). You can also look at services like uTest, though they're real pricey.

Re:Why are there not more freelance testers out there? by cantlin on Thursday February 28, 2013 @10:19AM (#5298990)
Thanks for that - Rainforest look very interesting (what I can see of it). "QA as a service" sums it up nicely.
Re:Why are there not more freelance testers out there? by darkmethod on Thursday February 28, 2013 @09:51AM (#5298862)
If https://www.usertesting.com had an API, I think it would handle the majority of the points you listed.

UserTesting may already have one, however my brief two minutes of poking around didn't reveal that they do.

Re:Why are there not more freelance testers out there? by bengl3rt on Thursday February 28, 2013 @10:40AM (#5299124)
Some friends of mine have actually made a business out of this over at http://testloft.com

From what I understand the phone won't stop ringing so clearly there is strong demand for something like this out there.