News for hackers. Stuff that matters.
Re:Auto Scale your Heroku Apps with Hero Scale by blaisco on Thursday December 16, 2010 @08:59AM (#2012017)
Autoscaling Heroku workers is definitely a problem that people would like solved, but I see a few issues with trying to offer the solution as a SaaS. One, you're targeting developers. There are several github repos that do this kind of thing for free, and developers would know how to find and implement those. Two, those github repo's are going to do a better job of scaling because they can turn dynos/workers on and off instantly (e.g. as soon as a delayed job is done); much more cost effective than waiting up to 5 minutes to turn dynos/workers on/off. Three, you're targeting people that are trying to save money and _don't_ want to spend money.

As an aside, perhaps I (a cheap developer) am not in your target demographic, and you're really targeting folks with lots of Heroku apps and lots of money to spend. In which case you should be charging bundles more than $20/month.

Re:Auto Scale your Heroku Apps with Hero Scale by railsjedi on Thursday December 16, 2010 @09:03AM (#2012027)
Yep, I tried all the open source autoscaling heroku tools on Github. They were not easy to use, and had major problems (try them, you'll see!)

I think Heroku users value their time above all else. There's much cheaper ways to host your Rails apps. This tool allows Heroku users to save money while not having to spend days getting their autoscaling stuff working and tested.

Re:Auto Scale your Heroku Apps with Hero Scale by aaronbrethorst on Thursday December 16, 2010 @02:00PM (#2013151)
Pedro's DJ fork[1] has worked quite well for me. What didn't go well with it for you?

[1] https://github.com/pedro/delayed_job/tree/autoscaling

Re:Auto Scale your Heroku Apps with Hero Scale by steveklabnik on Thursday December 16, 2010 @03:58PM (#2013646)
It only scales jobs, it doesn't scale dynos.
Re:Auto Scale your Heroku Apps with Hero Scale by runT1ME on Thursday December 16, 2010 @05:02PM (#2013957)
>>I think Heroku users value their time above all else. There's much cheaper ways to host your Rails apps. This tool allows Heroku users to save money while not having to spend days getting their autoscaling stuff working and tested.

Then charge more!!!

I mean, you just said it yourself, your target market values time over money. Don't try to compete on price then. right? :)

Re:Auto Scale your Heroku Apps with Hero Scale by enoptix on Thursday December 16, 2010 @10:11AM (#2012255)
This one works exceptionally well with Resque:

https://gist.github.com/501160

Re:Auto Scale your Heroku Apps with Hero Scale by steveklabnik on Thursday December 16, 2010 @03:59PM (#2013649)
This scales workers, it doesn't scale dynos.
Re:Auto Scale your Heroku Apps with Hero Scale by enoptix on Thursday December 16, 2010 @08:55AM (#2012001)
I think this is a great idea however it would seem that this is more of a feature than a business. What happens when Heroku implements this feature themselves?

P.S. Love the website design, it really pops!

Re:Auto Scale your Heroku Apps with Hero Scale by railsjedi on Thursday December 16, 2010 @09:01AM (#2012019)
Hah, yep. I've been waiting for this feature from Heroku for over a year. Finally decided to just implement it ourselves. We then realized it might be nice to make it easy for other people.

We'd welcome Heroku implementing it! We actually think there's many other things we can add on top of Heroku that would be valuable so we're not too worried :-)

Re:Auto Scale your Heroku Apps with Hero Scale by jollyjerry on Thursday December 16, 2010 @02:11PM (#2013185)
the landing page design really grabbed me, but I'm also really impressed with how simple and functional the actual dashboard is when you login. I had signed up with another beta autoscaling service, but I never heard back from them again. Best of luck with the service! I'll be rooting for ya.
Re:Auto Scale your Heroku Apps with Hero Scale by uggedal on Thursday December 16, 2010 @09:38AM (#2012137)
Seems like they did not scale heroscale.com itself. All I get is:

  App crashed

  This application is temporarily offline.

  If you're the administrator of this app,
  please check your heroku logs for the backtrace.
Re:Auto Scale your Heroku Apps with Hero Scale by railsjedi on Thursday December 16, 2010 @11:24AM (#2012528)
Minor launch glitch. Fixed now :)

Definitely not related to scaling. Just couldn't connect to our redis server after we upgraded it.

Re:Auto Scale your Heroku Apps with Hero Scale by meskyanichi on Thursday December 16, 2010 @02:00PM (#2013150)
Negative Nancy. Ever heard of the "Backlog too deep" error? That's a scaling issue, not the error you mentioned.
Re:Auto Scale your Heroku Apps with Hero Scale by axod on Thursday December 16, 2010 @11:06AM (#2012450)
I get a bad ssl cert warning.
Re:Auto Scale your Heroku Apps with Hero Scale by jroes on Thursday December 16, 2010 @11:46AM (#2012610)
Yep. SSL cert warning on Safari for iPhone.
Re:Auto Scale your Heroku Apps with Hero Scale by railsjedi on Thursday December 16, 2010 @11:51AM (#2012625)
I think that's the only browser that the cert doesn't like. Guess now I know why godaddy sells SSL certs for 10 dollars
Re:Auto Scale your Heroku Apps with Hero Scale by jroes on Thursday December 16, 2010 @11:56AM (#2012643)
Re:Auto Scale your Heroku Apps with Hero Scale by axod on Thursday December 16, 2010 @12:00PM (#2012666)
I use godaddy certs without issue. Make sure you included the bundle certs etc etc.
Re:Auto Scale your Heroku Apps with Hero Scale by railsjedi on Thursday December 16, 2010 @12:23PM (#2012786)
Ah, cool. I'll get that fixed. I used the instructions from http://clearcove.ca/blog/2010/11/how-to-secure-a-rails-app-o... however it must have missed a step.
Re:Auto Scale your Heroku Apps with Hero Scale by knodi on Thursday December 16, 2010 @09:29AM (#2012107)
David Dollar that works at Heroku already wrote a (free) gem that auto scales your heroku apps.

https://github.com/ddollar/heroku-autoscale

Re:Auto Scale your Heroku Apps with Hero Scale by stephth on Thursday December 16, 2010 @12:28PM (#2012806)
I feel those who point "free" alternatives to Hero Scale have never actually tried to auto-scale their dynos. That gem is not a serious alternative.

David Dollar worked on it for one day and then never committed anything again (except for three months later, one little note: "This gem is a proof of concept and should not be used in production").

In my experience this gem crashes requests frequently (502 errors if I remember well). I don't know what's going on in that code - I wasted some time looking into it with no luck - but something in there is flawed.

Heroku is supposed to be simple. The idea of Heroku is you can focus on the design of your apps. Auto scaling turned out to be a huge pain and waste of time for me. I ran out of patience and moved my Ruby code to the Google App Engine.

Re:Auto Scale your Heroku Apps with Hero Scale by enoptix on Thursday December 16, 2010 @10:51AM (#2012389)
That is only for dynos, not workers.
Re:Auto Scale your Heroku Apps with Hero Scale by doorty on Thursday December 16, 2010 @09:31AM (#2012114)
This is a great idea. I looked at the auto scaling repositories on GitHub: 1) There wasn't a good solution for Rails 3 yet. 2) The GitHub repos were typically forks of existing repos (like for CollectiveIdea's Delayed Jobs) and therefore would not always be up to date. I wouldn't be too worried about Heroku implementing this (though I hope they do) because there isn't a direct incentive for them to save you money by auto scaling. I'm definitely going to try this out.
Re:Auto Scale your Heroku Apps with Hero Scale by StavrosK on Thursday December 16, 2010 @08:48AM (#2011970)
Wait, why doesn't Heroku itself do this?
Re:Auto Scale your Heroku Apps with Hero Scale by patio11 on Thursday December 16, 2010 @09:01AM (#2012022)
For an enterprise: autoscaling is either not a value add ("You can cut $40 a month off our $300 hosting bill? Absence of 'yay'.") or Really Freaking Hard And App Specific. SmugMug, as I recall, did a lot of work to dynamically spin up and shut down instances to minimize their bill (not a Heroku app, obviously), because their usage patterns consistently predicted high load for workers at certain times and low loads at other times.

For a ramen-munching startup: shaving $40 off our bill is very motivating. However, while we have dreams of scaling up, if you actually do it we're going to wig out when we see a four figure hosting bill. By the way, we're pathological customers who understand just enough of this to be a danger to ourselves, and we will blame you on the Internets when your system does exactly what we tell it to do.

Re:Auto Scale your Heroku Apps with Hero Scale by StavrosK on Thursday December 16, 2010 @10:57AM (#2012417)
I see your point, but why would a startup wig out when they scale? Presumably, revenues would scale with demand, so I would be quite grateful that my provider allowed me to satisfy the demand quickly and reliably...
Re:Auto Scale your Heroku Apps with Hero Scale by chc on Thursday December 16, 2010 @01:12PM (#2012987)
Real-life example of what Patrick is talking about: http://news.ycombinator.com/item?id=1688904
Re:Auto Scale your Heroku Apps with Hero Scale by StavrosK on Thursday December 16, 2010 @01:31PM (#2013058)
Oh, now I see. It's not so much about scaling up, then, as it is about forgetting to scale back down after a spike.
Re:Auto Scale your Heroku Apps with Hero Scale by notahacker on Thursday December 16, 2010 @09:01AM (#2012023)
Because its profit margins depend on clients provisioning at least a little more capacity than they need.
Re:Auto Scale your Heroku Apps with Hero Scale by humanimality on Thursday December 16, 2010 @08:54AM (#2011998)
Because it has many other things to do.
Re:Auto Scale your Heroku Apps with Hero Scale by kineticac on Thursday December 16, 2010 @02:23PM (#2013234)
This looks pretty cool. As a startup, any savings is worth it. Problem is, my app is too matured to try a few things that aren't proven / stable yet. I will wait to see if Heroku official includes this as an add-on. If so, I'm totally down.

I could implement it myself, but if it's coming and implemented by a team who's dedicated a lot more time than I can, then it's worth it.

Re:Auto Scale your Heroku Apps with Hero Scale by colinplamondon on Thursday December 16, 2010 @10:15AM (#2012263)
We drop $500-800/month on Heroku, so I just signed up to give it a shot- doesn't take a lot of savings to make it worthwhile.
Re:Auto Scale your Heroku Apps with Hero Scale by endlessvoid94 on Thursday December 16, 2010 @03:30PM (#2013524)
App Engine is the only service that gets this 'auto scaling' right. Unfortunately the rest of the service sucks.
Re:Auto Scale your Heroku Apps with Hero Scale by heffay on Thursday December 16, 2010 @09:22AM (#2012079)
Tried to add my Heroku account and got the typical rails 500 error:"We're sorry, but something went wrong."

EDIT: Refreshed and it seemed to work!

[deleted]
Re:Auto Scale your Heroku Apps with Hero Scale by heffay on Thursday December 16, 2010 @09:44AM (#2012158)
Looks good!
Re:Auto Scale your Heroku Apps with Hero Scale by axod on Thursday December 16, 2010 @11:07AM (#2012458)
Isn't Heroku supposed to auto-scale EC2?

So we have Heroscale autoscaling Heroku which autoscales EC2??

Am I missing something?

Re:Auto Scale your Heroku Apps with Hero Scale by ihunter on Thursday December 16, 2010 @11:18AM (#2012500)
Yes and no. Right now, if you're running at one dyno then you're pulled from the heroku "mesh" if you run idle. However, this is a free account so it's not really saving you any money.

Heroku doesn't auto manage your dyno and workers based on usage. You set dynos at 10, you're running 10 throughout the month. Likewise with workers.

Heroscale ramps your dynos and workers up/down based on necessity.

Re:Auto Scale your Heroku Apps with Hero Scale by tpz on Thursday December 16, 2010 @11:30AM (#2012549)
Since the site doesn't describe this in any detail: can you define 'necessity'? In other words, can you tell us anything about how and when your service decides to scale up or down, for dynos and for workers? And what have you done to avoid porpoising (to borrow an aviation term for lack of a better option coming to mind at the moment.)

Also, can your service scale workers all the way down to zero and then spark up the first worker upon the next job submission? Or can it only scale workers as low as one?

Re:Auto Scale your Heroku Apps with Hero Scale by ihunter on Thursday December 16, 2010 @11:43AM (#2012601)
Good feedback, will put together a "wtf is it doing" page.

I'm familiar with the "pilot induced oscillations" from a first hand basis, scared the crap out of me. The desired scaling quality is quick ramp ups and then gradual, minute based ramp downs. This is to handle a sudden influx of traffic to the site. We don't just peg your dynos anytime something comes in. And the free accounts are set at 3 max, so don't worry about it blowing up your bill.

Dynos are ramped up fast as a response to incoming traffic and average wait times per request. I'm still refining this algorithm so feedback during beta would be awesome.

The algorithms for workers are slightly different than dynos since they feed of different info. The answer to your question is yes, it will scale down to zero if you have nothing in the queue. You can override this by setting server min and max thresholds for workers.

Drop us a line at contact AT heroscale DOT com and happy to talk more.

Re:Auto Scale your Heroku Apps with Hero Scale by tpz on Thursday December 16, 2010 @12:53PM (#2012914)
Thanks for the details. I will have a think about what other questions I might like to ask you and will try to fire them over to your contact email in the next day or so.
Re:Auto Scale your Heroku Apps with Hero Scale by knodi on Thursday December 16, 2010 @11:26AM (#2012537)
I'm not sure I want to give my Heroku account password to an external service.
Re:Auto Scale your Heroku Apps with Hero Scale by railsjedi on Thursday December 16, 2010 @11:54AM (#2012635)
We're working on a heroku proxy API that will allow people to hook into heroscale via oath.
Re:Auto Scale your Heroku Apps with Hero Scale by jeffio on Thursday December 16, 2010 @02:08PM (#2013174)
Yes, I will probably wait for oath before signing up and checking it out.
Re:Auto Scale your Heroku Apps with Hero Scale by richardburton on Thursday December 16, 2010 @09:16AM (#2012061)
Threw an error when I tried to connect my Heroku account :(
Re:Auto Scale your Heroku Apps with Hero Scale by ihunter on Thursday December 16, 2010 @09:52AM (#2012184)
Fixed, was redis issue.
Re:Auto Scale your Heroku Apps with Hero Scale by richardburton on Thursday December 16, 2010 @09:16AM (#2012062)
Lovely graphics though.
Re:Auto Scale your Heroku Apps with Hero Scale by dclaysmith on Thursday December 16, 2010 @09:38AM (#2012135)
Ouch. "App crashed" messages not the best marketing for an auto-scaling app.
Re:Auto Scale your Heroku Apps with Hero Scale by Kudos on Thursday December 16, 2010 @09:36AM (#2012133)
"App crashed"

Looks like it couldn't scale to the hacker news traffic. Is that Irony?

Re:Auto Scale your Heroku Apps with Hero Scale by cmelbye on Thursday December 16, 2010 @09:39AM (#2012140)
It would be if that error meant that the app couldn't handle the traffic. "App crashed" just means that their code is doing something weird and the thin process crashed.