News for hackers. Stuff that matters.
Re:Netflix Chaos Monkey Upgraded by benhoyt on Wednesday October 19, 2016 @12:28PM (#12745225)
What do you mean by "do devops correctly" to avoid SSH on boxes? (I'm a developer, not devops.)
Re:Netflix Chaos Monkey Upgraded by devonkim on Wednesday October 19, 2016 @12:38PM (#12745303)
"Devops" has bazillions of meanings, but avoiding (human) ssh to production boxes is a generally sound principle these days because our infrastructures are becoming harder to understand by poking at boxes one or two at a time now even for forensic analysis.
Re:Netflix Chaos Monkey Upgraded by dberg on Wednesday October 19, 2016 @01:06PM (#12745561)
So logging in to a server to check a logfile (assuming i dont or cant do centralized logging) is considered anti-devops ?

Edit: Sorry responded to wrong parent, sigh.

Re:Netflix Chaos Monkey Upgraded by sametmax on Wednesday October 19, 2016 @01:26PM (#12745742)
It's just a matter of scale. If you are at the scale of netflix, vm are probably too complex black boxes, and logs output somewhere else anyway. Plus the problem may involve the interraction of several vm, or the network, or other composants together.
Re:Netflix Chaos Monkey Upgraded by saryant on Wednesday October 19, 2016 @11:52PM (#12749634)
At this scale, you basically have to have centralized logging. When you have thousands of parallel instances of a single application, searching logs box-by-box just isn't practical.

Consider also that if you're elastically scaling EC2 instances and you need logs off an instance that's since been terminated, too late! That disk is gone. So again, you need a central log service.

Re:Netflix Chaos Monkey Upgraded by vacri on Thursday October 20, 2016 @01:12AM (#12749866)
Parsing logs isn't the only way to troubleshoot.
Re:Netflix Chaos Monkey Upgraded by flukus on Thursday October 20, 2016 @01:23AM (#12749901)
It's not even the best way, just sometimes it's the only way.
Re:Netflix Chaos Monkey Upgraded by jaffa214525 on Wednesday October 19, 2016 @12:58PM (#12745476)
Immutable infrastructure [1] is preferred. If SSH is detected, you must assume something on the server changed, and has deviated from the baseline.

[1] https://www.oreilly.com/ideas/an-introduction-to-immutable-i...

Re:Netflix Chaos Monkey Upgraded by RBerenguel on Wednesday October 19, 2016 @12:41PM (#12745326)
If deployment is automated and "clean", images get baked into machines and they just start. For instance, we use Ansible against the machine itself on boot, so we don't really need ssh access to it: everything is automated (but we keep it open to troubleshoot anything that may happen)