News for hackers. Stuff that matters.
Re:The End of Microservices by dasil003 on Wednesday July 20, 2016 @10:24PM (#12134188)
Equating "Microservices" with "Information Superhighway" really shows the tech bubble that this article is written in. "Information Superhighway" was a vacuous but mainstream term used by politicians and public figures. "Microservices" is a tech hype train led by expensive consultants and pickaxe companies thriving off the current tech boom.

Don't get me wrong, a service-oriented architecture is the only thing that scales to large companies. Once you get to dozens of engineers and millions of lines of code you will inevitably need to have an SOA because Conway's law. Also, there is a learning curve to building microservices which improved tooling really helps with.

However the thing that really grates at me is how these articles say things like:

> Services are now an everyday, every-developer way of thinking

With nary a mention of the overhead. There is no way around it, distributed systems have an irreducible complexity no matter how good your tooling and boilerplate is. You have to put in extra work to decouple everything and handle failure in a way that actually reap the benefits of the distributed system. And in the end, what these articles always gloss over is the interface between these systems. If you can easily define an interface between systems that stays relatively stable as the service evolves, then congratulations, you have a good candidate for a service with minimal overhead. But for most applications, those interfaces are shifting all the time, and there is no better tooling than multiple logical services running within one binary and build system where integration testing and validation is cheap. This is a real fucking problem people, it's not going to go away because there's a couple billion dollars worth of venture-backed startups ready to blow their cash on you in the vain and most likely misplaced hope that they are actually going to have to scale to dozens of engineers. Premature scalability is one of the worst siren songs for young engineers and we're seeing it in spades right now.

Re:The End of Microservices by dexwiz on Wednesday July 20, 2016 @10:40PM (#12134247)
It's all a balancing act. The two main contenders are developers and scalability.

It makes no sense for a single team to run 2000 microservices that come together into a single app. The amount of overhead for managing so many interfaces is insane.

At the same time, it's hard to justify 2000 developers working on a single binary. You end up with entire teams dedicated to managing and deploying. Companies do it (Google), but it's not without costs.

If every microservice runs with the same specs (container size/# of containers), then there is nothing gained from scalability. If anything, you're probably wasting a large amount of resources if your containers cannot shrink any more.

At the same time, if you are deploying thousands of copies of of a single binary, when most of the resources go to 1% of the code, then you're wasting resources with needless copies.

The (micro)services fad is definitely brought on by the recent rise of virtualization. It's probably a bit overboard.

Re:The End of Microservices by honkhonkpants on Thursday July 21, 2016 @01:52AM (#12135027)
You got the Google part wrong. Google is all in on microservice architecture and has over a decade of experience doing it. There is not some gigantic google.exe program. Perhaps you have heard that Google uses a single source code repo and drew an incorrect conclusion.
Re:The End of Microservices by sp527 on Thursday July 21, 2016 @12:52AM (#12134743)
Speaking as a young engineer, I can tell you many are already looking past microservices towards things like AWS Lambda, AMQs, and BaaS, which make a great deal more sense. Why? Because it helps reduce dev effort down to purely the logic you'd have to write no matter what, with better guarantees about reliability and scalability, and less maintenance. I hesitate to say 'serverless' because that still feels somewhat out of reach, but that's the direction things are trending towards.

I also get the sense that a lot of purists moulded in the ways of yore are alarmed at the waning relevance of their skillset. This to me seems like a bigger problem than the evolution of software paradigms.

Re:The End of Microservices by dasil003 on Thursday July 21, 2016 @01:02AM (#12134808)
Oh yeah, I don't think it's bad research going into this. I mean I've been writing software professionally for almost 20 years now and I am super excited about (for example) containerization and other trendy areas. I think it's great that people are pushing the boundaries of SOAs, and I think microservice is a good term describing how the boundaries are being pushed. We will all benefit from the improved tooling and experience gained.

My only complaint is this ostrich mentality of declaring ubiquity and ignoring the downsides and unsuitable cases. I suppose drinking the koolaid might be necessary to really buy in and push the paradigm forward, but sometimes it feels like willful ignorance.

Re:The End of Microservices by sp527 on Thursday July 21, 2016 @01:09AM (#12134850)
I agree completely. I may simply have had the luxury of so far working in environments wherein software fads aren't hailed as Swiss-Army panaceas. Here's to hoping my track record doesn't ever trend Dilbertesque :)
Re:The End of Microservices by dasil003 on Thursday July 21, 2016 @01:39AM (#12134975)
Me too. At this point in my career I've worked very closely with more than 100 programmers for long periods of time, and only one of them would I classify as being overly interested in fads. To the contrary, I give a ton of credit to the vast majority of programmers as always being pragmatic about the problem at hand.

I think the problem lies more in the PR, advocacy and conference circuits where there's an incentive and agenda to present things as silver bullets. It mirrors a greater problem in public discourse that everything has become so polarized that nuanced debate is drowned out by noisy, confident blowhards.

Re:The End of Microservices by sp527 on Thursday July 21, 2016 @01:49AM (#12135016)
"The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt." (Bertrand Russell)

Back when I was still an employee, I strove to take a more intermediate tact that let me be more vocal about technical direction. What's surprising is how willingly people with authority will listen to what you have to say, once they realize you know what you're doing. I've also been fortunate to have had roles that enabled that in the first place. And now I'm trying my hand at entrepreneurship, which feels practically utopian :)

Re:The End of Microservices by djspoons on Thursday July 21, 2016 @10:42PM (#12141413)
Yeah, we were debating about whether I should write a post about "the end of servers" instead of "the end of microservices." I thought we'd get a livelier discussion with microservices, ;) but I totally agree that they are already getting to be yesterday's buzz word.
Re:The End of Microservices by allengeorge on Thursday July 21, 2016 @08:24AM (#12136335)
While I appreciate the allure of such models, one point gives me pause: tracing and debugging. Maybe the tools have caught up to the point where tracing why a job wasn't triggered or failed in the middle is a simple task, but it always seemed tedious to me. My hope is that the explosion of the microservice framework will trigger a corresponding explosion in the tools to trace/debug it.
Re:The End of Microservices by xyzzy123 on Thursday July 21, 2016 @01:08AM (#12134841)
I think this is a smaller evolution than microservices / non microservices.... as others have pointed out, the real discussion is autonomy versus centralised control.
Re:The End of Microservices by sp527 on Thursday July 21, 2016 @01:13AM (#12134866)
If that's the case, I'd argue we're conflating software development management with software engineering execution. It's illogical to assert that utilizing microservices implies entirely forgoing centralization.
Re:The End of Microservices by xyzzy123 on Thursday July 21, 2016 @03:47AM (#12135376)
I agree with you. In my defense, people who want microservices are generally asking for developer autonomy, but just using technical language to do it, rather than managerial.
Re:The End of Microservices by sp527 on Thursday July 21, 2016 @12:05PM (#12137753)
I can believe that. This is why it's so crucial to have good management. I've also realized through my own experience that a good manager has to be in the trenches coding with his/her reports, at least part of the time. It's amazing how fast you can become irrelevant when you're unplugged and stuff like this is exactly why.
Re:The End of Microservices by estefan on Thursday July 21, 2016 @08:14AM (#12136285)
> AWS Lambda

Has local dev/testing been solved for that yet, and different environments, etc?

Re:The End of Microservices by sp527 on Thursday July 21, 2016 @11:52AM (#12137645)
Getting there. Wrapping Lambda functions for local execution isn't too hard since it's really just JS. e.g. https://www.npmjs.com/package/node-lambda
Re:The End of Microservices by spriggan3 on Wednesday July 20, 2016 @11:31PM (#12134440)
> Premature scalability is one of the worst siren songs for young engineers and we're seeing it in spades right now.

This. What happened to "make it work then make it scale" ?

Re:The End of Microservices by beagle3 on Thursday July 21, 2016 @04:21AM (#12135505)
> This. What happened to "make it work then make it scale" ?

The fact that it is wrong (or rather, incomplete)

It should be "make it work with a clear path to scaling, then make it scale" - that's true with respect to both software engineering and business plans.

It's the same with "premature optimization is [the|a root of [all]] evil" - Premature optimization is a waste of time and often paints you into a corner. However, if you don't think about the bottlenecks and how to optimize them in advance, you more often than not find later, when profiling, that there are not enough hotspots, and the performance is "lost" all over the place.

Re:The End of Microservices by lmm on Thursday July 21, 2016 @05:00AM (#12135626)
Not my experience at all. Systems that were designed as simply as possible can be unpicked and made scalable - it takes time and effort but it's doable. Systems that were designed to be scalable are much worse, because you have to undo all of that work first before you can start actually making them scalable.
Re:The End of Microservices by beagle3 on Thursday July 21, 2016 @07:18AM (#12136091)
Simpler systems are easier to scale than more complicated ones, for sure - but things like making sure that your database is easily shardable are often cheap (even free) before you start, and might be extremely expensive later on -- I'm familiar with a project that eventually spent a few hundred thousand dollars on some high performance database (Oracle RAC or something, don't remember exactly), where -- if the database schema was shardable in advance -- they could have been ok with 10-20 cheap machines running MySQL.

And I remember an earlier project that had to be completely rewritten in the early '90s because at the time, Oracle couldn't yet scale even throwing money at it (and DB2 reportedly could - but the required Mainframe was not an option).

Simple is often best, yes. But not oblivious-to-the-future simple.

Re:The End of Microservices by allengeorge on Thursday July 21, 2016 @08:19AM (#12136312)
Perhaps you guys are talking about different things? There are certain architectural decisions (schema design, etc.) that can dramatically impact future scalability. Sometimes if you implement it the "simple" way the design can very quickly reach its limits and have to be replaced.

And, honestly, sometimes you've done variants of the same problem enough that you know where some of the bottlenecks are inevitably going to be - so why not design them out right at the start?

Re:The End of Microservices by pm90 on Wednesday July 20, 2016 @10:59PM (#12134311)
This is a great point. I don't think the hype is due to a fad alone. There are a lot of good reason why microservices are much easier to create and deploy today: containerization and the associated technology around it. This makes microservices a very natural paradigm for app deployment.

Of course, its not a holy grail. But we see that kind of thing over and over again. I think its OK; it gets developers genuinely excited to try new technology. Its only when this hype influences dangerous decisions that I'm worried about.

Re:The End of Microservices by djspoons on Thursday July 21, 2016 @10:41PM (#12141405)
I wrote the post with pretty rose-colored glasses on. :)

I totally agree that microservices can be a form of premature optimization, in particular because of the cost with today's tooling. But I think there's hope that lot of those costs will go down (both in terms of dev time and infrastructure) with things like AWS Lambda, etc.

Anyway, if devs think a little more about the interfaces, I think that will be a good thing.