Re:Microsoft Appoints Kevin Scott as CTO
by 65827 on Tuesday January 24, 2017 @03:12PM
(#13475019)
Was linkedin really known for their engineering? Honest question I don't recall ever hearing anything good or bad.
[ Parent
| on HN ]
Yes, for starters they wrote things like Kafka and Samza there @ LinkedIn. I consider this post required reading for anyone wanting to build serious business distributed data pipelines, and guess where it came from? :)
https://engineering.linkedin.com/distributed-systems/log-wha...
Re:Microsoft Appoints Kevin Scott as CTO
by eternalban on Tuesday January 24, 2017 @03:24PM
(#13475112)
Microsoft's technology portfolio & research /far outstrips/ anything LinkedIn did or would encounter.
I'd guess that this appointment is Cloud/Azure related.
Sure, and it is also likely 100x the size. That wasn't the original question, the question was what has LinkedIn done engineering wise. I'd say Kafka was a pretty smashing success having met all of Neha, Jun, and Jay Kreps and talked Kafka with them.
Re:Microsoft Appoints Kevin Scott as CTO
by clumsysmurf on Tuesday January 24, 2017 @05:19PM
(#13476257)
Thanks for the link. I noticed their idea of "unified log" in a diagram about 45% of the way down. Does anyone know if this is the same thing talked about in the forthcoming Manning book "Unified Log Processing"?
Re:Microsoft Appoints Kevin Scott as CTO
by alexatkeplar on Tuesday January 24, 2017 @06:22PM
(#13476767)
Hey clumysmurf - author of the book here; yes indeed, the book is heavily influenced by Jay Kreps' LinkedIn paper.
Re:Microsoft Appoints Kevin Scott as CTO
by catwell on Wednesday January 25, 2017 @04:24AM
(#13479983)
Voldemort was pretty influential too, even though it has been eclipsed by Cassandra.
Re:Microsoft Appoints Kevin Scott as CTO
by mendicantB on Tuesday January 24, 2017 @03:25PM
(#13475123)
World class engineers (especially data eng) who built some amazing open source things, but internally was a mess.
The reason LinkedIn is a terrible product is because it was mired internally by chronically poor engineering leadership and product politics. Nothing ever got shipped. This new rollout is nice but 5 years too late.
I'm really hoping the MSFT buy will change things, as I really believe in the product and there are some great engineers there.
Re:Microsoft Appoints Kevin Scott as CTO
by jdoliner on Tuesday January 24, 2017 @03:17PM
(#13475054)
A number of notable opensource projects in the big data space were started at LinkedIn. Kafka is probably the most prominent example but there are others too. So I'd say they're fairly known for their engineering. You definitely don't get good projects like that coming out of a company without really good engineers making them.
Kafka, Samza, Databus, etc. LinkedIn is pretty capable when it comes to engineering. From what I've seen, most people's beef with LI tends to be product-related
Re:Microsoft Appoints Kevin Scott as CTO
by glibgil on Tuesday January 24, 2017 @03:15PM
(#13475040)
Yes, they kind of overdid it in fact. They created Kafka, for example
pretty much every big company in silicon valley is known for their engineering talent, since top talent just moves around from company to company (e.g: lots of ex-googlers, ex-facebook, etc).
Re:Microsoft Appoints Kevin Scott as CTO
by fergie on Wednesday January 25, 2017 @03:08AM
(#13479652)
The only nugget that sticks in my mind was the massive password hack a few years ago.
I wonder if Linkedin has a lot of MS tech in their stack? If so, and MS wants to push further into consumer facing services in the cloud, I can see why this appointment might make sense.