News for hackers. Stuff that matters.
Re:Acquisition and maintenance of a band of minions by jmillikin on Sunday June 16, 2013 @11:41AM (#5888775)
For those who don't regularly follow rachelbythebay.com, this post is a Google allegory. I disagree with a couple points.

First, Google really doesn't care as much about education as people think they do. They do love experience. I never graduated high school, and was hired into an SRE position (= programmer writing large-scale sysadmin tools) based on previous work experience. Grades are only useful if you've got nothing else to show off.

Second, if you want employees to be loyal to a company with unusually good perks, taking them fresh out of school is a terrible approach. Many people working here indeed have no real idea what working at non-tech companies is like, and that means they assume every other company is like Google. I have heard stories of employees getting frustrated on some project, leaving to work at (e.g.) a bank or webdev shop, and not realizing until their first day that there's no free food, or gym, or weekly heckling of the CEO. I used to work at a defense contractor, I know what it's like being a programmer employed at a non-tech company, and I don't want to ever go back.

(In other words, Google might get better retention by implementing Rumspringa)

Third, the proprietary parts aren't as pervasive as the article portrays. Our Linux kernel has weird Google-specific interfaces, but they're always in some stage of upstreaming and will eventually be in Linus's trunk. Our RPC system uses the same protobuf rpc-stubs that are generated by the open-source protobuf compiler. Desktops and Laptops run stock {Ubuntu,Windows,MacOS} with a few extra binaries. MapReduce and BigTable were published and inspired dozens of open-source implementations. Many of our Python-based tools have web frontends written with Django. Many systems persist data in MySQL.

When Google engineers avoid particular in-fashion systems such as Rails or MongoDB or node.js, it's not because we're ignorant of them, it's because we think they're not good enough.

Re:Acquisition and maintenance of a band of minions by ScottBurson on Sunday June 16, 2013 @01:10PM (#5889071)
Google, huh? I was thinking of Palantir as I read that -- and Microsoft. I guess I have too many friends in their 40s and 50s who work at Google.
Re:Acquisition and maintenance of a band of minions by hobs on Sunday June 16, 2013 @02:51PM (#5889432)
The constant inversion of evil is a clear reference.
Re:Acquisition and maintenance of a band of minions by jholman on Sunday June 16, 2013 @05:03PM (#5889979)
I strongly strongly agree with you about new-grad Googlers not knowing how good they have it (food/gym/tgif? TECH STOP!), and I agree with you about degrees too. As an amusing joke the article's close enough to home to be funny; as a serious criticism... well, it's far enough off to be funny.

The proprietary thing is dead-on, though. I started listing major proprietary technologies, got close to twenty, and decided I wasn't sure how much of that was trade secret, and deleted it. Google technology looks like we're on a different Galapagos island from the rest of tech, and the landbridge sunk into the sea in 2003, and once in a while a bird in a windstorm carries a seed across. Usually Google tech is superior to comparable outside tech, sometimes it's inferior.

As an aside for Googlers, have you seen that Facebook thing "Buck", that some ex-Googler named Michael Bolin "invented"? I don't even know what to say.

Re:Acquisition and maintenance of a band of minions by x1024 on Sunday June 16, 2013 @05:38PM (#5890118)
Honestly? The difference between G and F is that F actually released the code. You saying "but we had this for years...as a proprietary system" kind of proves the author's point.
Re:Acquisition and maintenance of a band of minions by jholman on Sunday June 16, 2013 @06:33PM (#5890326)
Which point of which author? Also, what did you think I was arguing?
Re:Acquisition and maintenance of a band of minions by jjwiseman on Monday June 17, 2013 @01:11PM (#5894399)
There's a tradition of ex-Googlers re-implementing the Google build system (it was definitely my favorite part of the Google infrastructure). See, e.g., twitter's pants: https://github.com/twitter/commons/blob/master/src/python/tw...
Re:Acquisition and maintenance of a band of minions by rachelbythebay on Sunday June 16, 2013 @04:44PM (#5889892)
Regarding NIH, some places have found an interesting way to have their cake and eat it too. First, they create something interesting. Then they release it to the world. That way, their formerly-proprietary thing becomes the standard, or at least, shows up in the marketplace.

Protocol Buffers was this back in ... 2007? Too bad Thrift happened first, right?

This is leading up to the kernel of another post: how to undercut the competition: hire the people who created their Secret Sauce, then have them build it again, but this time, release it to the world. Now the competition doesn't have their exclusive magic carpet to ride around on any more.

Re:Acquisition and maintenance of a band of minions by throwawaykf on Sunday June 16, 2013 @05:41PM (#5890136)
Interestingly, a senior Googler I once talked to derisively mentioned how competitors like Facebook were open sourcing projects that used to be proprietary Google technology, mostly based on work done by people FB poached from Google. I realize it's just another anecdote, but the word "we" was used enough during the dialog to indicate that it was a common view within Google.

I guess it's a viable strategy, but nobody likes it when it's done to them.

Re:Acquisition and maintenance of a band of minions by rachelbythebay on Sunday June 16, 2013 @05:59PM (#5890192)
Oh, sure, in 2007 when Thrift came out first, I was on board with that sentiment, too. "Oh, wow, they hired someone who was an intern here last year, and now they have their own Protocol Buffers, surprise surprise." It was easier to disparage it than it was to get concerned about our own well-being.

Now, however, every time they release something like this, I just crack up laughing. The servers, the software-defined switched network, all of it. It just keeps going. The real magicians have moved on and are now sharing their creations with the rest of the world.

If only I had a copy of that internal post which basically said "either we open-source our own stuff, or other people are going to do it for us, and we're going to be behind the eight ball". I want to say it was a Yegge Buzz post but I can't remember for sure. It's been three or four years.

Leakers, you know how to find me. Contact info in profile.

Re:Acquisition and maintenance of a band of minions by yuhong on Tuesday June 18, 2013 @04:48AM (#5898206)
While on the topic of Google, what do you think of Larry? Sergey? Eric?
Re:Acquisition and maintenance of a band of minions by jrockway on Sunday June 16, 2013 @10:31PM (#5891088)
People outside of Google have heard of Protocol Buffers?
Re:Acquisition and maintenance of a band of minions by nostrademons on Monday June 17, 2013 @01:50AM (#5891647)
Take a look at the credits for Diablo 3 or Starcraft 2. Blizzard is a big fan of protobufs.

It's also interesting to look at the mailing list for Cap'n Proto - there are a bunch of folks from FourSquare, Twitter, etc. helping out. Many of them are ex-Googlers, and many cited being big fans of proto2 as their reason for helping out with Cap'n Proto.

Re:Acquisition and maintenance of a band of minions by chetanahuja on Sunday June 16, 2013 @03:57PM (#5889681)
While I'll accept your point about many google employees having no or un-cool degrees, there's no denying that google recruiters covet fresh college grads from well-known schools and your grades in school are an important factor. Not that google is unique is considering these factors in recruitment, but it's absolutely ridiculous to imply that google does not care about these factors.

As for proprietary parts not being important, I have major disagreements with your characterization of how well the linux kernel upstreaming works (having worked in that team) and other assertions about stock desktops (Stock Ubuntu ? Really ?) but I suspect that discussion will quickly veer into areas of confidentiality (if it hasn't already).

As for MapReduce and BigTable, I'm still wishing and hoping for the open-source world to catchup with the originals (Why do people keep writing enormous in-memory data stores in Java!??) Enough said.

Re:Acquisition and maintenance of a band of minions by jmillikin on Sunday June 16, 2013 @04:24PM (#5889786)

  > there's no denying that google recruiters covet fresh
  > college grads from well-known schools and your grades in
  > school are an important factor.
Sure, Google recruiters hit up Stanford and MIT just like every other tech company. But they don't reject candidates for having a non-ivy-league background.

  > I have major disagreements with your characterization
  > of how well the linux kernel upstreaming works (having
  > worked in that team)
From within the team it may have seemed bad, from from nearby teams it's apparent that there's a lot of progress in upstreaming. All of the cgroup stuff, for example, seems to be going in relatively smoothly.

  > other assertions about stock desktops (Stock Ubuntu ? Really ?)
Based on your LinkedIn you left in late 2012; there's been a lot of work with Canonical since then on reducing how much customization Google needs to do for its desktops.
Re:Acquisition and maintenance of a band of minions by VLM on Sunday June 16, 2013 @04:08PM (#5889725)
"For those who don't regularly follow rachelbythebay.com, this post is a Google allegory."

LOL its about 10x funnier if you read it as a seminary allegory. It really does fit pretty well.

Re:Acquisition and maintenance of a band of minions by philwelch on Sunday June 16, 2013 @01:16PM (#5889100)
IANAG but at large companies like Google, you're bound to see proprietary internal systems for handling a lot of problems like remote services, package management, deployment, load balancing, etc. Part of that is massive scale. Another part is that, while small generic programs and libraries do well in the wild, having a standardized, integrated system is more cost-effective inside a large business.
Re:Acquisition and maintenance of a band of minions by michaelt on Sunday June 16, 2013 @03:40PM (#5889610)
I, too, ANAG but I've heard 20% time projects only count towards performance reviews if they make it into production.

That could easily create a bias towards using things made in 20% time in preference to industry-standard tooling.

In reality I assume it's a combination of the two: Sometimes the internal tools really are the best for Google's specific needs; other times there's probably Not Invented Here Syndrome at work, same as anywhere else.

Re:Acquisition and maintenance of a band of minions by spankalee on Sunday June 16, 2013 @08:40PM (#5890743)
There's no such rule.
Re:Acquisition and maintenance of a band of minions by nostrademons on Monday June 17, 2013 @01:54AM (#5891659)
No such rule, but you are generally judged on impact and not effort at Google. If your efforts don't make an impact, then they aren't going to be counted in your favor.
Re:Acquisition and maintenance of a band of minions by philwelch on Monday June 17, 2013 @11:14AM (#5893625)
Isn't that how the world works? Effort without impact is just wasted effort.
Re:Acquisition and maintenance of a band of minions by nostrademons on Monday June 17, 2013 @05:13PM (#5895996)
The real world, yes. In many institutions (eg. the public school system, most giant megacorps) you get points for showing up and putting in the appearance of effort even if you don't accomplish anything.
Re:Acquisition and maintenance of a band of minions by leviself on Sunday June 16, 2013 @11:58AM (#5888825)
Just curious, why is Mongo not good enough or do you just mean as opposed to BigTable?
Re:Acquisition and maintenance of a band of minions by jmillikin on Sunday June 16, 2013 @12:03PM (#5888847)
We have BigTable and protobufs and real MapReduce, so there's no reason to use MongoDB with its JSON storage and Javascript-based mapReduce() function. It's like comparing CSV to SQLite.
Re:Acquisition and maintenance of a band of minions by twic on Sunday June 16, 2013 @07:51PM (#5890594)
So what's PostgreSQL in that analogy?
Re:Acquisition and maintenance of a band of minions by jmillikin on Sunday June 16, 2013 @08:05PM (#5890643)
Spanner, I suppose.
Re:Acquisition and maintenance of a band of minions by btilly on Sunday June 16, 2013 @01:50PM (#5889222)
A major need for a company like Google is visibility into their distributed architecture. When you make every component be built on their libraries running on their architecture, you have a common toolset across all of your properties to track any performance problem back to its root cause.

MongoDB does not provide this type of visibility. Either within that common toolset or in any other way.

Re:Acquisition and maintenance of a band of minions by bhickey on Sunday June 16, 2013 @12:47PM (#5888993)
Technical points aside, MongoDB is licensed under the AGPL. Why would I use it when freer alternatives exist?