Re:AWS Device Farm adds support for iOS
by AndrewKemendo on Wednesday August 05, 2015 @11:55PM
(#10014451)
We found it hard to find reliable testers for iOS without building your own team or doing it all on your own devices. Maybe Amazon will come through, but we'll see.
I'd love to see a service where one super tech just tries to break your application on every supported device for a couple hours. A room full of toddlers might also work.
Re:AWS Device Farm adds support for iOS
by i336_ on Thursday August 06, 2015 @03:22AM
(#10015032)
I think it would be a truly viable startup idea to connect app developers with "naive" people - soccer moms who simply haven't got the time to learn tech properly, 70-year-olds who've never used a smartphone, 3 year olds, etc.
Being able to get your website or app (or even good ol' desktop program!) tested by people who have <specific metric> exposure to <granular list of options> wrt. technology would be invaluable, I think.
I consider it sad that this either doesn't exist, or isn't yet a standard part of the common consciousness/culture.
Re:AWS Device Farm adds support for iOS
by JDeArte on Thursday August 06, 2015 @02:16AM
(#10014841)
We created an Android AND iOS farm for automated game testing. You don't need to root iOS to get it done - it's just a PITA to do it right. You end up needing an attached Mac running XCode to send commands & you can't use the internet connection through the wire so we set up a local secure wifi network.
The only devices we had to "root" (aka put in developer mode) were some android devices that wouldn't allow us to change the HOSTS file otherwise ;-)
I'm glad that AWS is now offering this type of service, I can't wait to try it out.
Re:AWS Device Farm adds support for iOS
by gruez on Wednesday August 05, 2015 @11:33PM
(#10014391)
Did they work with apple to create a custom version of iOS to integrate with amazon's service, or did amazon jailbreak the devices and installed their own hooks?
Re:AWS Device Farm adds support for iOS
by NateLawson on Thursday August 06, 2015 @01:27AM
(#10014701)
More importantly, what do they do to keep users from jailbreaking the device via software? Especially with Android, there are a lot of software root flaws and the privileged surface area is a lot bigger than the hypervisor AWS uses for EC2.
The summary makes it sound like they only wipe your app from the device, not reinstall the OS between users.
Re:AWS Device Farm adds support for iOS
by jakozaur on Thursday August 06, 2015 @04:55AM
(#10015320)
I believe it doesn't matter for 95%+ of users.
EC2 is used to run production services with sensitive data.
Most Android/iOS testing is done with made up data, without privileged access to production. So even if it get compromised, it probably not much different from installing an app on jailbreaked device be end user.
Re:AWS Device Farm adds support for iOS
by itsmeduncan on Thursday August 06, 2015 @07:50AM
(#10015822)
"Pricing is based on device minutes, which are determined by the duration of tests on each selected device. AWS Device Farm comes with a free trial of 250 device minutes. After that, customers are charged $0.17 per device minute. As your testing needs grow, you can opt for an unmetered testing plan, which allows unlimited testing for a flat monthly fee of $250 per device."
From the FAQ[1] which albeit was a bit buried.
edit: It is also at the bottom of the landing page now.
I'd love to see a service where one super tech just tries to break your application on every supported device for a couple hours. A room full of toddlers might also work.
Being able to get your website or app (or even good ol' desktop program!) tested by people who have <specific metric> exposure to <granular list of options> wrt. technology would be invaluable, I think.
I consider it sad that this either doesn't exist, or isn't yet a standard part of the common consciousness/culture.
The only devices we had to "root" (aka put in developer mode) were some android devices that wouldn't allow us to change the HOSTS file otherwise ;-)
I'm glad that AWS is now offering this type of service, I can't wait to try it out.
Actual real devices?! I would really like to get a bit of a behind-the-scenes on how they managed that. :P
The summary makes it sound like they only wipe your app from the device, not reinstall the OS between users.
EC2 is used to run production services with sensitive data.
Most Android/iOS testing is done with made up data, without privileged access to production. So even if it get compromised, it probably not much different from installing an app on jailbreaked device be end user.
From the FAQ[1] which albeit was a bit buried.
edit: It is also at the bottom of the landing page now.
1: https://aws.amazon.com/device-farm/faq/
That's a bit steep? You could recoup any iOS device in <= 3 months.
It's in your Google Play developer console