Re:Show HN: I built testelf - app testing service for your i...
by matthuggins on Wednesday January 23, 2013 @02:03PM
(#5104632)
"You upload a build of your app without providing any additional instructions, and we'll test your app from a user's perspective..."
It seems like a user should have at least some idea of what the app is. For example, I'll read the first couple sentences of an app's description and look at some screenshots/video before I decide to download it. This might be something you want to consider instead of having absolutely no idea what the app is before running it, since I assume most users have at least some context when opening an app.
Re:Show HN: I built testelf - app testing service for your i...
by Cushman on Wednesday January 23, 2013 @02:30PM
(#5104790)
It's usually a good idea when user testing to tell testers as little as possible about the product. It's true that real-world users have more context than that, but it can be worth it to get more unfiltered feedback— the first few moments you watch a user flounder to even understand what they're looking at can be the most valuable.
Re:Show HN: I built testelf - app testing service for your i...
by ssong on Wednesday January 23, 2013 @02:37PM
(#5104826)
Good point! There is an option to attach additional information (description, notes, link to website/app store) when uploading an individual build. We do ask for a little bit of information about the app in general when the first build is uploaded so that we have some context.
Re:Show HN: I built testelf - app testing service for your i...
by jmatthew3 on Wednesday January 23, 2013 @02:09PM
(#5104669)
This is a pretty cool idea, and something I would have considered trying to get my boss to pay for when I was a developer. I didn't see on your website - do you test on a wide variety of hardware platforms, or just iPhone 5 and iPad? Different versions of iOS?
Also, do you have any terms, in particular, regarding confidentiality?
Re:Show HN: I built testelf - app testing service for your i...
by ssong on Wednesday January 23, 2013 @03:07PM
(#5104999)
Thanks for asking! We do test on common devices (retina/non-retina iPad, iOS 5/6), and we're going to carefully consider which devices to cover as we grow. I am also very aware of the importance of confidentiality, such as keeping test results private -- I think the service wouldn't make sense without it. Our exact terms will be available before we publicly launch.
Over the past few months, I recruited and trained a small team of testers, developed internal testing tools, and worked with a handful of startups who are piloting our service. The service is now open for beta -- I would love to hear feedback from hackers and startups on HN who can give it a shot.