News for hackers. Stuff that matters.
Re:Why we don't schedule deployments during off-hours by scottyallen on Thursday October 21, 2010 @04:52PM (#1817396)
Deploying new code should never be an "adventure". It should be a simple, replicable process that allows you to safely stop or rollback at any given time. It should have enough checks in place that the impact from any given mistake is minimized. There should never be any "oh shit" moments.
Re:Why we don't schedule deployments during off-hours by cullenking on Thursday October 21, 2010 @06:51PM (#1817776)
There will always be "oh shit" moments, no matter how much you think there won't. Yeah, you can mitigate alot of them, but things get through. Even using deploys which can be rolled back, frozen dependencies or bundler for us rails folk, shit can and will happen.
Re:Why we don't schedule deployments during off-hours by scottyallen on Thursday October 21, 2010 @08:46PM (#1818120)
You're right - I should be more clear what I mean. "Oh shit" moments caused by a change you made due to pushing a new piece of code should never last more than a minute or two, between the time you realize something went wrong and the time you run the command that reverts things back to the known good state. At Shopkick, this usually means running a command which flips a symlink that points at the current code/config to use and restarts/reloads the server in question.