News for hackers. Stuff that matters.
Re:Porting dl.google.com from C++ to Go by acqq on Friday July 26, 2013 @06:29PM (#6110961)
I guess, what you miss is that the author was the author of LiveJournal, memcached, now also of groupcache in Go. So the guy who rewrote the program was much, much more capable that any "typical" programmer.
Re:Porting dl.google.com from C++ to Go by fbuilesv on Friday July 26, 2013 @09:38PM (#6111503)
What relevance does that add to this presentation? It's interesting by itself.

What do the presentation (or our discussion) gain from the fact that Brad is a super smart guy "much more capable than the 'typical' programmer"? Why are we even bringing up that point? :)

Re:Porting dl.google.com from C++ to Go by jdale27 on Friday July 26, 2013 @10:51PM (#6111697)
A bunch of "typical" programmers wrote a program in C++, and it turned out crappy. A "super smart guy" rewrote it in Go, and it turned out nice. How much of the delta between crappy and nice was due to the language, and how much to the programmer? (And how much is due to the new programmer learning from the old programmer's mistakes?)

As with all anecdotal language advocacy, you have to take it with a grain of salt, and in this case maybe more than usual.

Re:Porting dl.google.com from C++ to Go by chrissnell on Saturday July 27, 2013 @12:54AM (#6111917)
Brad even acknowledges that the original program was nice in it's day. C++ complicated things but it sounded like the bigger problem was developers leaving the team and new features being hackishly implemented.
Re:Porting dl.google.com from C++ to Go by scottlamb on Saturday July 27, 2013 @02:22AM (#6112054)
And don't underestimate "changing environment". As Brad said, "in 2007, using local disk wasn't restricted ... in 2012, containers get tiny % of local disk spindle time ... cluster file systems own disk time on your machine, not you."

Within Google today, if you're directly using local disk instead of the Google storage stack, you're going to have a bad time. Even more so if you're calling read() from a single-threaded event loop.

Re:Porting dl.google.com from C++ to Go by acqq on Saturday July 27, 2013 @03:48AM (#6112164)
It gives the fuller perspective. The Go libraries are something very new. People who developed the libraries know them inside out. Outside of that group of people, there's certainly much less knowledge about them. A lot of the claims in the article about the full coverage of some standard in some Go library versus the incomplete one by the given C++ program obviously come from somebody who invested enough time to study the standards and (at least) study the implementation inside of the said libraries. That is, something like that either you know or you can just say authors claim that they adhere to the standards -- which ones, how much; you can't know, much less you are able to compare.

So, for me, that is somebody who didn't follow the state of Go libraries, it was much bigger new information in the presentation the author's certitude that some library covers everything of the standard (good to know how much care was invested there!) than the fact that when somebody has already made some very good tools he can more easily use them then probably anybody else who'd start without such a deep knowledge.

My own takeaway was "now that I know that at least some libraries are very well thought-out that's a good argument to consider when deciding about the use of Go in some future project." Still it's to weight against the learning curve and the quality and ease of use of the available libraries in other more common languages. In that light it's still good to know that the author of the presentation is really very competent.

Not directly related to your question, I also applaud the author's honesty in describing the problem he solved: first, the underlying assumptions changed: I can imagine that the main reason for fetching the data to the local disk in 2007 was that then fetching the data directly from the remote storage was much slower than it is now, making his current approach impossible then. Second, it's not that the original design was as inefficient as the later suboptimal modifications made it. Third, it was a project in which for a while nobody wanted to invest the time to. That's the convenient point to jump in and demonstrate what you can do with the new tools and your knowledge and time. Once you change the equation, a product once almost without the future can become a basis for future much more successful projects.

Re:Porting dl.google.com from C++ to Go by redbad on Saturday July 27, 2013 @06:55AM (#6112478)

    > The Go libraries are something very new. People who    
    > developed the libraries know them inside out. Outside of 
    > that group of people, there's certainly much less 
    > knowledge about them.
I guess it's a tautology that the people who developed something know it best, but you're being really disingenuous here by implying that only those people would be capable of doing a project like this. Go's stdlib HTTP server takes great pains to be accessible and powerful.
Re:Porting dl.google.com from C++ to Go by e12e on Sunday July 28, 2013 @08:29AM (#6116489)
I think the implication was that the developers know the actual capabilities, and so know if there were any dark corners of the standards that were just papered over with stuff that might break in some subtle way, in non obvious use-cases.

So it's a word of confidence that, yes not only is the interface nice, but the implementation is also good (enough) -- and you probably won't regret leaning on it in a future project.

Re:Porting dl.google.com from C++ to Go by sbarre on Friday July 26, 2013 @10:26PM (#6111640)
It adds some validity to the opinions and points he makes? I will certainly pay more attention to a presentation if I know that the presenter has credibility..
Re:Porting dl.google.com from C++ to Go by Cthulhu_ on Friday July 26, 2013 @09:00PM (#6111405)
Your comment implies that even Google, which has a reputation of hiring only the best of the best software developers, has "typical" programmers. My faith in the world has just been restored, <3.
Re:Porting dl.google.com from C++ to Go by ryanmolden on Saturday July 27, 2013 @12:37AM (#6111896)
Best of the best that apply to Google. Or in other words, their hiring process is "Hire the best people that apply here", or, you know, the hiring policy of every company in the world. You could argue they uniquely attract smart people with some kind of high IQ gravity centered at the Googleplex, but that seems unlikely. Makes for good marketing copy though.
Re:Porting dl.google.com from C++ to Go by hung_yao on Saturday July 27, 2013 @02:08PM (#6113807)
The degree to which it is enforced today - I'm not sure, but:

http://googleresearch.blogspot.com/2006/03/hiring-lake-wobeg...

Re:Porting dl.google.com from C++ to Go by asveikau on Saturday July 27, 2013 @01:52AM (#6112016)
Right, because there's never been a Googler who has ever made a mistake. All of them are perfect and none of them are stupid, never a bad hire made or even a momentary lapse of judgment.
Re:Porting dl.google.com from C++ to Go by shin_lao on Saturday July 27, 2013 @04:27AM (#6112230)
If I'm correct he's a C programmer, not a C++ programmer.
Re:Porting dl.google.com from C++ to Go by raverbashing on Saturday July 27, 2013 @06:17AM (#6112415)
Yes, they usually do better than "C++" programmers on C++

They know how to keep things simple

Re:Porting dl.google.com from C++ to Go by shin_lao on Saturday July 27, 2013 @02:21PM (#6113840)
That kind of comment is uncalled for (I'm a C++ programmer).