News for hackers. Stuff that matters.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by Domenic_S on Thursday October 06, 2011 @03:53PM (#3081381)
I was chugging along happily until I started observing someone else's testing session!

I typed "neato!" into their search bar; they promptly logged off.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by jcampbell1 on Thursday October 06, 2011 @12:38PM (#3080696)
I used to be interested in this type of service, but then I got an SSD. With an SSD it takes about 5 seconds to boot windows through parallels, and now cross browser testing is no longer a chore.

I am willing to admit that I pirate windows for the sole purpose of supporting IE with my webapps. It would be too expensive to do it legitimately, so my solution is not for everyone.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by npollock on Thursday October 06, 2011 @12:53PM (#3080751)
Here's a great discussion about how to run multiple versions of IE on a single windows instance,

http://stackoverflow.com/questions/574463/running-internet-e...

Re:BrowserStack is out of beta: super-easy multi-browser tes... by jcampbell1 on Thursday October 06, 2011 @01:13PM (#3080830)
I have found multiple IE just doesn't work the same a real IE install, and it is hard to duplicate the same bugs as users see. As you can see the top rated answer is "don't do it, use VMs".
Re:BrowserStack is out of beta: super-easy multi-browser tes... by yuhong on Thursday October 06, 2011 @01:33PM (#3080899)
I think MS provides VM images of Windows for testing IE.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by wpietri on Thursday October 06, 2011 @04:39PM (#3081553)
If they are the same ones we tried, they are a giant pain. Lots of screwing around to get everything downloaded and set up right for multiple version of IE. Then they expire every few months, requiring regular doses of rigmarole.

And when you finally have them set up, you know what prize you win? You get to debug some crazy-making IE issue. As far as I'm concerned, free isn't enough: they should come with masseuses and bottles of good scotch in compensation.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by quandrum on Thursday October 06, 2011 @04:25PM (#3081491)
Re:BrowserStack is out of beta: super-easy multi-browser tes... by SkyMarshal on Thursday October 06, 2011 @12:58PM (#3080763)
Do you test all of IE6, 7, 8, and 9 like that?
Re:BrowserStack is out of beta: super-easy multi-browser tes... by jcampbell1 on Thursday October 06, 2011 @01:07PM (#3080797)
Yes, I do. Which is part of the reason I pirate windows, because it is the only way I know how to get an IE6 install.

It is reasonably fast to setup, because once you install XP, you can copy the VM, and install IE 7, copy the VM and install IE 8. I then do the same thing for Vista/Windows 7.

With 8 Gb of ram, I have no problem running 3 Xps, and 2 Windows 7, at the same time.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by SkyMarshal on Friday October 07, 2011 @12:17AM (#3082644)
"With 8 Gb of ram, I have no problem running 3 Xps, and 2 Windows 7, at the same time."

That's good to know. I'm in the market for a laptop to replace my desktop, and I want enough RAM to run multiple VMs like that. Was thinking I'd need to find one with 12 or 16GB, which rules out MacBooks (unless I get an expensive 3rd party 2x8GB RAM upgrade). But maybe not.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by jcampbell1 on Friday October 07, 2011 @11:44AM (#3084436)
I configure XP to have 512MB of ram, and Windows 7 to have 1 GB. This works fine if all you are running is the OS and a browser. I will re-iterate that an SSD is the important factor because it cuts the VM startup time by 75% in my experience.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by wavephorm on Thursday October 06, 2011 @01:29PM (#3080889)
I used to buy Windows licenses, even multiple use family packs. And I would install them in Parallels on my Mac for testing IE. That works, until your Windows keys start to expire. I guess I installed them too many times. Now my keys no longer work.

So now I pirate copies of Windows that I have paid for, because it's too much hassle to work with the legitimate versions.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by jmathes on Thursday October 06, 2011 @04:46PM (#3081571)
Browserstack is great, but it's still catching up to Sauce Scout (disclaimer: I work at Sauce Labs). It needs better support for testing firewalled or localhost sites, and it needs security (it re-uses VMs)

Awesome work, guys! I know first hand how hard it is to maintain a product like this :)

Re:BrowserStack is out of beta: super-easy multi-browser tes... by mrud on Thursday October 06, 2011 @11:50AM (#3080518)
Is this somehow related to browserling/stackvm? Afaik the idea is the same but browserstack looks much more polished and mature.

Ok i just discovered that browserstack needs java so it seems they are using a different sw stack

Re:BrowserStack is out of beta: super-easy multi-browser tes... by ritesharora on Thursday October 06, 2011 @11:52AM (#3080530)
Browserstack needs Java only for creating local tunnel via web interface. For the rest it uses Flash!
Re:BrowserStack is out of beta: super-easy multi-browser tes... by mrud on Thursday October 06, 2011 @02:07PM (#3081008)
Ah ok i'm sorry i misread that.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by kgtm on Thursday October 06, 2011 @12:37PM (#3080688)
A bit off-topic, but i find the Plans & Pricing page to be a very good example of how to design for an attention-lacking crowd, i.e. most web users. In particular, the team-size icons is a rare example of using eye-candy to succinctly help in clarifying for whom each package is tailored. Or maybe i am just easily excited today!

If anything, i would invert the per-person price with the overall price in order to give emphasis to "more people is actually cheaper". There is something in descending prices that makes people feel good.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by there on Thursday October 06, 2011 @01:30PM (#3080892)
the rotated text does not look good in firefox 7/mac:

http://i.imgur.com/XsiTi.png

i know of a service they can use for testing their website in different browsers...

Re:BrowserStack is out of beta: super-easy multi-browser tes... by gregdetre on Thursday October 06, 2011 @02:43PM (#3081115)
This looks interesting - we've been pretty happy with crossbrowsertesting.com until now, which is also worth a look.

Here's what I'd love next - we'd write a bunch of QUnit javascript tests, put them behind a private url on our staging server, and then be able to run those tests from the command-line on multiple browsers (through BrowserStack, say), and spit back the output in a form that Jenkins understands. I'd certainly pay $20/month for that, and maybe more if it was great.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by substack on Thursday October 06, 2011 @06:41PM (#3081941)
We at browserling will be releasing something perfect for that in a week or so! Sneak peak: http://browserling.com:9088/
Re:BrowserStack is out of beta: super-easy multi-browser tes... by ritesharora on Thursday October 06, 2011 @03:34PM (#3081301)
We are partnering with Jquery Swarm to run Jquery unit tests! ... so this will happen very soon.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by DougWebb on Thursday October 06, 2011 @01:02PM (#3080782)
This looks cool, but I'm not sure about the long-term value.

Looking at their browser list, I could test all Firefox, Opera, and Chrome versions, one version of IE, and the Windows versions of Safari on one Windows 7 box.

I could add to that three VMs for older versions of IE, and a Mac (maybe with a VM) for Mac Safari versions. If the main Win7 machine is also a VM, I could do this all on the Mac.

So, that's a total of 5-6 OS licenses, which would cost $750-$1000.

At $19/month for a single user, BrowserStack becomes more expensive after 2-3 years. At the small team rate of $68/year it becomes more expensive after one year. (I could host VMs on a server and have my testers RDP into it; they can't use the VMs simultaneously but with 4 testers and 5-6 VMs that's not a problem.)

To me, the pricing is right on the edge, which forces me to evaluate the effort of maintaining local VMs and browsers (an invisible cost is most organizations) vs the potential risks of running my in-development software and providing access to my development environments to a third-party over the internet. If the pricing was lower and clearly less expensive than maintaining my own VMs, it'd be a slam-dunk decision and the other factors wouldn't even be considered. (I'm thinking about this from a "how does a developer sell this to corporate management" perspective.)

Re:BrowserStack is out of beta: super-easy multi-browser tes... by gizmo on Thursday October 06, 2011 @01:12PM (#3080825)
Installing and configuring VMs up to the point where you can do good testing with them is a painful and tedious work. Why waste the time of expensive professionals on something if you can fix the problem for $70-$150 a month?

$70 bucks a month is only real money if you're a broke startup. Otherwise it's peanuts.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by Bootvis on Thursday October 06, 2011 @01:50PM (#3080932)
And don't forget the maintenance you have to do on those machines. You're testing is 5 minutes under way and BAM Windows updates wants your attention for a reboot.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by jordanlev on Thursday October 06, 2011 @01:24PM (#3080875)
maintaining local VM's and browsers may be "an invisible cost" to organizations, but what about the zillions of web designers out there?
Re:BrowserStack is out of beta: super-easy multi-browser tes... by ghc on Thursday October 06, 2011 @12:22PM (#3080636)
Just tried this on my in-development web app. The good news is that it works like a charm. The bad news is that the browsers keep prompting to save the password of my test account. I wish they'd turned of password manager for all of the browsers.

I also feel a little weird typing in my test account password into their site.

Re:BrowserStack is out of beta: super-easy multi-browser tes... by ritesharora on Thursday October 06, 2011 @01:25PM (#3080879)
Though all passwords/history/etc are cleaned. Your idea seems like a better one!
Re:BrowserStack is out of beta: super-easy multi-browser tes... by chefsurfing on Thursday October 06, 2011 @12:43PM (#3080715)
Bravo BrowserStack team! I am using this to test IE7 on our staging environment. Your signup process was great, I was able to jump-in and start testing immediately. I think you could add better communication and assurances about security and private information. Keep up the good work.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by ritesharora on Thursday October 06, 2011 @01:18PM (#3080847)
All user information is kept private and everything is erased once user stops testing. Sure, the security document is coming soon!
Re:BrowserStack is out of beta: super-easy multi-browser tes... by revorad on Thursday October 06, 2011 @04:27PM (#3081504)
This is really well done. It's going to be very useful to us, thanks!

Edit: The tunnel to my local server doesn't work. I keep getting "There's no server running at port 80".

Re:BrowserStack is out of beta: super-easy multi-browser tes... by jbm on Thursday October 06, 2011 @08:50PM (#3082201)
Just showed this to some people at a company I'm working at. I'm guessing they are going to spring for it - 4 seats at least :P Good job dude.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by lobster_johnson on Thursday October 06, 2011 @01:15PM (#3080838)
Too slow to use over here in Europe. Feels like using VNC on a dialup.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by ritesharora on Thursday October 06, 2011 @01:21PM (#3080861)
Currently our server in europe is at Ireland. Soon coming up with more in europe: london, amsterdam and more
Re:BrowserStack is out of beta: super-easy multi-browser tes... by angry-hacker on Thursday October 06, 2011 @04:46PM (#3081572)
Fellow European here. Unfortunately also too slow use it properly...
Re:BrowserStack is out of beta: super-easy multi-browser tes... by kennystone on Thursday October 06, 2011 @12:40PM (#3080702)
Cool logo... what I really need is android/ios device testing.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by ritesharora on Thursday October 06, 2011 @01:22PM (#3080871)
its coming soon!
Re:BrowserStack is out of beta: super-easy multi-browser tes... by kwamenum86 on Thursday October 06, 2011 @05:15PM (#3081693)
Clever logo but butt ugly.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by ikbear on Thursday October 06, 2011 @10:13PM (#3082381)
Too slow to accept.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by daev on Thursday October 06, 2011 @05:37PM (#3081763)
maintenance is spelled wrong
Re:BrowserStack is out of beta: super-easy multi-browser tes... by zackattack on Thursday October 06, 2011 @06:05PM (#3081852)
I would prefer to use http://browserling.com/ all day. The home page design is way more awesome.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by diamondhead on Thursday October 06, 2011 @05:15PM (#3081698)
An API would be great for us since it would let us to run our tests against all web browsers by making some http requests. Wouldn't it be revolutionary?
Re:BrowserStack is out of beta: super-easy multi-browser tes... by substack on Thursday October 06, 2011 @06:44PM (#3081952)
As I just mentioned elsewhere this thread already, browserling is rolling out exactly this service really soon! Here's a sneak peak: http://browserling.com:9088/
Re:BrowserStack is out of beta: super-easy multi-browser tes... by ritesharora on Thursday October 06, 2011 @05:20PM (#3081715)
Hi, why don't you drop an email at [email protected] with your idea as we have some similar ideas cooking up.
Re:BrowserStack is out of beta: super-easy multi-browser tes... by diamondhead on Thursday October 06, 2011 @05:51PM (#3081805)
Sure, I've just send it.