News for hackers. Stuff that matters.
Re:What Is ‘Site Reliability Engineering’? by StreamBright on Thursday April 20, 2017 @07:23AM (#14155704)
This is not true at all. Most of the great first SRE were systems engineers (this is how Amazon used to call SREs) who understood the entire stack from the UI down the the network packet and OS kernel level. Most software engineers do not have serious networking or operating system knowledge. On the top of that, there is a reason why performance engineers are so rare, understanding the complex computing systems we have is not an easy task. System administrators are able to configure your services but not necessarily know all the details of the operating system and file systems that is required to be an SRE. I think you are trying to oversimplify this subject quite a bit.
Re:What Is ‘Site Reliability Engineering’? by jacquesm on Thursday April 20, 2017 @07:32AM (#14155742)
> Most of the great first SRE were systems engineers (this is how Amazon used to call SREs) who understood the entire stack from the UI down the the network packet and OS kernel level.

Aka the 'full stack developer' as opposed to the 'full stack developer' that knows both JavaScript, PHP and how to install the base distribution of CentOS.

Re:What Is ‘Site Reliability Engineering’? by metaphorm on Thursday April 20, 2017 @01:02PM (#14158521)
you're commenting on sloppy use of language. you're right, we do tend to abbreviate and exclude relevant descriptive words. the "full stack developer" that knows both JavasScript and PHP (or whatever), and probably some database stuff, and how to config a HTTP server, and a few other bits of web odds and ends is really a "full stack web application developer". usually there is enough context to know if "web application" has been abbreviated out of the term though.

as for the other kind of "full stack developer", the legendary creature that is equally comfortable doing UI scripting and Linux Kernel hacking...well personally I've never met one. mythical beast in my experience.

Re:What Is ‘Site Reliability Engineering’? by throwaway2016a on Thursday April 20, 2017 @09:42AM (#14156507)
> Most software engineers do not have serious networking or operating system knowledge.

Anecdotally, this seems wrong but may actually be sadly right.

I don't know how you can get through a decent Computer Science program without knowing these things. Although, I acknowledge quality in CS programs vary hugely.

We had to write an Operating System (with basic memory and process management), know the OSI model up and down, and be able to deep dive into TCP/IP and UDP packets. In addition to coding and math.

I'm actually pro software "engineer" but perhaps we should draw the line somewhere on a bare minimum of skills required. Probably about the line of an ABET accredited undergraduate BS in CS degree?

Re:What Is ‘Site Reliability Engineering’? by pzh on Thursday April 20, 2017 @10:13AM (#14156783)
Why are people surprised? Taking all the coursework in Math, Programming, Algorithms, Operating Systems, Computer Networks, Security and Cryptography, Distributed Systems, Databases, etc., and also learning and internalizing all that knowledge is a significant time investment. Yet many people here would be offended at the idea that you can't be a proper engineer without a CS degree, and would insist that all you need is a three-month JS/Angular bootcamp and then you're golden. A formal CS degree in itself may not be a requirement, but the time investment in acquiring the knowledge sure is.
Re:What Is ‘Site Reliability Engineering’? by StreamBright on Thursday April 20, 2017 @09:54AM (#14156598)
I can speak of based on the ~100 interviews I conducted hiring SDEs. There are very few who could pass an SRE I/II interview, yet I know of few.
Re:What Is ‘Site Reliability Engineering’? by dmoy on Thursday April 20, 2017 @12:02PM (#14157883)
What's the pass/fail rate for sde though? If you interview 100 and 10 pass through to sde, and 2 of those could do sre, that's not actually that bad.
Re:What Is ‘Site Reliability Engineering’? by Sean1708 on Thursday April 20, 2017 @11:13AM (#14157390)
Because Bachelor's degrees don't give you a serious knowledge of or experience in anything, they give you shallow knowledge of and experience in a broad array of topics.
Re:What Is ‘Site Reliability Engineering’? by snowwrestler on Thursday April 20, 2017 @11:42AM (#14157672)
This is just not true. Engineers in many disciplines other than CS (mechanical, electrical, civil, etc) begin serious professional work with only a bachelors degree.
Re:What Is ‘Site Reliability Engineering’? by throwaway2016a on Thursday April 20, 2017 @12:38PM (#14158249)
> other than CS

This is simply not true as well. CS majors also can begin serious work with just a BS degree. I have no idea what school(s) the parent topic is refering to but remind me not to recommend people go there...

Four years is a LOT of time to get deep on multiple CS topics not just a broad overview. If you finish 4 years of serious study and don't have deep knowledge of a few things you did college wrong.

College is the only time in your adult life where your only job is to learn. It is incredible that many of us get that opportunity and that some people come out of it with just broad knowledge is disappointing.

In my CS program, senior and most of junior year were almost entirely specialized courses where we had a choice to pick a topic that interests us and deep dive. (AI, graphics, networking, bioinformatics, big data, programming language theory, etc). All the general studies were mostly done by the end of sophomore year.

Re:What Is ‘Site Reliability Engineering’? by snowwrestler on Thursday April 20, 2017 @10:29PM (#14162682)
That's great. The "CS grad who doesn't actually know how to write production software" is a well-trod trope, but hopefully it is less true than it used to be.
Re:What Is ‘Site Reliability Engineering’? by dsfyu404ed on Thursday April 20, 2017 @04:37PM (#14160608)
You are absolutely wrong in those examples. Those fields are so broad that there is not time to specialized in college. They only learn the fundamentals.

You could have two identical ME grads go on to specialize in completely different things. One guy might spend his entire career working on hypoid gear sets and another might work exclusively on marine diesel rotating assemblies.

Ditto for EE, CE and so on.

Re:What Is ‘Site Reliability Engineering’? by mentat on Thursday April 20, 2017 @04:26PM (#14160509)
How it runs in the ideal case is different from experience in how it "actually" runs and fails. That's the biggest gap IMHO.
Re:What Is ‘Site Reliability Engineering’? by graycat on Thursday April 20, 2017 @11:15AM (#14157403)
> reason why performance engineers are so rare, understanding the complex computing systems we have is not an easy task.

At times it has been possible to make some progress on the complexity by regarding each application, virtual machine, server, server cluster, or server farm as a network of queues and apply queuing theory and/or Monte Carlo simulation. In addition some of the old work in optimization under uncertainty likely applies.

Re:What Is ‘Site Reliability Engineering’? by srean on Friday April 21, 2017 @01:55PM (#14167710)
Have you looked at stochastic network calculus ?

Network of queues can become hrrendoulsy difficult to analyze unless one assumes memoryless arrivals etc etc. Network calculus and stochastic network calculus simplifies things a great deal by going after bounds rather than exact answers. You might like it

Re:What Is ‘Site Reliability Engineering’? by graycat on Friday April 21, 2017 @04:15PM (#14169045)
I never heard of "Network calculus and stochastic network calculus". Certainly no such topics were in any of the applied math grad courses I took.

For "going after bounds rather than exact answers", for analyzing network performance, there is a hugely simplifying approach: Just look at the bottlenecks and largely f'get about the rest; maybe that is related to what you mentioned.

For network queuing, really I was suggesting using that as a paradigm to formulate an analysis; I accept that analytic solutions are unpromising -- more generally, the exact probabilistic calculations out of queuing theory research are complicated even for simple cases. So, for solutions, i.e., actionable information, use Monte Carlo.

Once I knew a guy at IBM's Watson lab who was big on such things. There was a claim that at one time his work was useful in designing some of an IBM mainframe I/O subsystem. He had some software that I used once. His software wanted to collect the usual descriptive statistics, but I wanted the sample paths from the Monte Carlo, got those, and did more analysis of those.

Re:What Is ‘Site Reliability Engineering’? by srean on Friday April 21, 2017 @04:42PM (#14169278)
> I never heard of "Network calculus and stochastic network calculus".

...and now you have :)

> Certainly no such topics were in any of the applied math grad courses I took.

Yeah they are a newer development. Stochastic network calculus more so. Network calculus is older, it even has a wikipedia page https://en.wikipedia.org/wiki/Network_calculus A key idea is convolution but in the max-plus algebra and martingale large deviations.

> For network queuing, really I was suggesting using that as a paradigm to formulate an analysis;

Indeed. SNCs can be a helpful tool there. Yes they are bounds, but a lot of progress has been made to make them tight https://arxiv.org/pdf/1303.4114.pdf they arent quite there yet numerically but tight enough to give an intuition. NC bounds are a lot looser.

Re:What Is ‘Site Reliability Engineering’? by samfisher83 on Thursday April 20, 2017 @09:43AM (#14156521)
If you take comp sci you are required to take a class in os and networking. I think many swe are cs majors.
Re:What Is ‘Site Reliability Engineering’? by StreamBright on Thursday April 20, 2017 @09:53AM (#14156587)
Yes, and those classes teaches you the theory while when you are working for companies you need to know the practical side of things. In our country even the theory is lagged behind the practical usage by 5-10 years. Funnily enough most the senior SREs I know do not have any formal education in CS (anecdotal evidence).