News for hackers. Stuff that matters.
Re:AWS, MongoDB, and the Economic Realities of Open Source by pjc50 on Monday January 14, 2019 @08:35AM (#18902797)
Two comments:

Firstly, the discussion at the front about the music industry is quite insightful, but I'd go further - they didn't want to sell convenience at first. Used to the physical embodiment of recordings rather than the de-materialized reality of digital music, they spent years working on mandated inconvenience through DRM and other legal actions. Always remember that if the music industry had won unopposed you'd have to pay a license fee to set a MP3 as your ringtone, as well as having to license every copy on every device separately.

Secondly, about mongodb: I'm reminded of https://www.gwern.net/Complement "Commoditize Your Complement", but in reverse.

Open source software is by definition commoditized. Everyone can have a copy at no cost. So what is an "open source VC funded" company doing? Creating complements and selling those. It's just that there's no intrinsic reason that the same company that gives away labour as OSS should also make the best complements to that OSS. It's not a law of nature that e.g. Redhat should be the best people to provide consultancy on RHEL.

The music industry did not expect their product to become free to distribute at the margin, but every company operating as an "OSS startup" has to know from the start that their software can't be charged for directly.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @10:31AM (#18903671)
I realize that the idea of “Commoditizing Your Complements” has gained new life lately on HN, but let’s give credit where it’s due - Joel Spolsky in 2002.

https://www.joelonsoftware.com/2002/06/12/strategy-letter-v/

Re:AWS, MongoDB, and the Economic Realities of Open Source by ShardPhoenix on Monday January 14, 2019 @05:29PM (#18907140)
The first four words of the linked Gwern article are "Joel Spolsky in 2002". In fact he gives him credit 3 times!
Re:AWS, MongoDB, and the Economic Realities of Open Source by statictype on Monday January 14, 2019 @07:52PM (#18908011)
Yes but why not link to the original (which is also more readable)
Re:AWS, MongoDB, and the Economic Realities of Open Source by gaius on Monday January 14, 2019 @01:42PM (#18905233)
Sure, but Spolsky didn’t invent the concept. The idea is probably hundreds of years old.
Re:AWS, MongoDB, and the Economic Realities of Open Source by cstejerean on Monday January 14, 2019 @01:05PM (#18904897)
Well this is like an inverse for that strategy. If your core product is OSS you aren’t commoditizing its complements, but rather trying to build and charge for those complements (such as hosting or management services, consulting, etc) because you can’t charge for the product itself.
Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @08:37PM (#18908198)
For a profit seeking corporation, your core product is the product that makes you money.

Roku sells hardware, but the CEO has said in no uncertain terms that their core product is aggregating user data to sell to advertisers. That they don’t consider themselves a hardware company.

IBM was also big into open source to sell mainframes and services.

Re:AWS, MongoDB, and the Economic Realities of Open Source by kgwxd on Monday January 14, 2019 @11:14AM (#18904049)
Credit for what?
Re:AWS, MongoDB, and the Economic Realities of Open Source by mynegation on Monday January 14, 2019 @11:23AM (#18904106)
For “commoditize your complements” strategy, which was probably popularized by Stratechery but GP found earlier piece by Joel Spolsky about the same idea.
Re:AWS, MongoDB, and the Economic Realities of Open Source by kgwxd on Monday January 14, 2019 @11:43AM (#18904286)
So credit for a phrase? Neither invented the actual strategy.
Re:AWS, MongoDB, and the Economic Realities of Open Source by TuringNYC on Monday January 14, 2019 @12:44PM (#18904728)
There is a lot of value in distilling some amorphous concept or unclear practice into a simple rule that makes sense and frames it in a template, making it easy to both recognize and implement.
Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @12:09PM (#18904484)
Well, Einstein didn't invent Relativity but he gets credit for describing it.....
Re:AWS, MongoDB, and the Economic Realities of Open Source by woah on Tuesday January 15, 2019 @09:56AM (#18911486)
He did invent it. Our scientific models are just that: models that can make accurate predictions.
Re:AWS, MongoDB, and the Economic Realities of Open Source by kgwxd on Monday January 14, 2019 @01:39PM (#18905206)
So every discussion involving relativity has to mention Einstein even when it's not germane?
Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @02:06PM (#18905457)
Everyone keeps linking to the Gwem.net website instead of using the primary source.

If Albert Einstein had a blog post about relativity, I would rather read that than someone’s interpretation....

Re:AWS, MongoDB, and the Economic Realities of Open Source by jefftk on Tuesday January 15, 2019 @08:11AM (#18910868)
The Gwern post is better: it starts by linking, quoting, and summarizing the Spolsky post, but then goes on to give many more examples.
Re:AWS, MongoDB, and the Economic Realities of Open Source by db48x on Monday January 14, 2019 @04:11PM (#18906515)
He wrote books about it, have you read them?
Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @04:25PM (#18906652)
Well actually....
Re:AWS, MongoDB, and the Economic Realities of Open Source by stcredzero on Monday January 14, 2019 @12:33PM (#18904655)
Used to the physical embodiment of recordings rather than the de-materialized reality of digital music, they spent years working on mandated inconvenience through DRM and other legal actions.

Isn't GPL and AGPL Copyleft another form of mandated inconvenience for companies? Come to think of it, many laws are mandated inconvenience with the stated purpose of correcting for some masked externality.

So what is an "open source VC funded" company doing? Creating complements and selling those. It's just that there's no intrinsic reason that the same company that gives away labour as OSS should also make the best complements to that OSS. It's not a law of nature that e.g. Redhat should be the best people to provide consultancy on RHEL.

The historical record indicates that there are indeed network effects at play with communities of experts. However, the historical record also indicates that such effects on pools of expertise aren't powerful enough to create monopolistic single factions which can lock out all competitors.

every company operating as an "OSS startup" has to know from the start that their software can't be charged for directly.

All money made from open source really comes down to the application of expertise to do things with software. The ultimate question is whether software expertise itself can be commoditized.

(EDIT: Another way to phrase it: Is software an ouroboros? It's a snake eating its own long tail. Software keeps eating itself, but it continues the process by creating sufficient change to allow itself to grow as an industry. As time goes on, there are more experts needed. This then begs the question, "What could possibly cause that to change?")

Re:AWS, MongoDB, and the Economic Realities of Open Source by jrumbut on Monday January 14, 2019 @11:10AM (#18904021)
I think the use of revenue is a little disingenuous.

Producing, packing, and shipping a physical copy and marketing on broadcast television were major expenses of the pre-2000 world that they no longer have to the same extent (maybe they still buy TV ads but I haven't seen one in a decade at least, used to be all over the place). If you keep smaller part of $12 or a larger part of $0.99 your revenue could fall with profits staying the same.

Maybe the overall picture stays the same but this was very distracting for me from the argument made in the article. It made me wonder what else isn't quite right.

Re:AWS, MongoDB, and the Economic Realities of Open Source by pjc50 on Monday January 14, 2019 @12:17PM (#18904539)
The peak on the graph is 1999.

At the start of the decline, there wasn't really a good way to buy music in digital format at all. iTunes launched in its current form in 2003.

The decline between those years was essentially the industry losing $12 sales to $0 sales: either directly to piracy, or to competition for time and attention on the Internet.

Youtube blew even more of a hole in the industry in 2005, replacing purchases with streaming. This plays $0.0006 per stream.

(The corresponding profits graph is really hard to find, which suggests that the data may not be so publicly available?)

Re:AWS, MongoDB, and the Economic Realities of Open Source by jimmychangas on Monday January 14, 2019 @09:33AM (#18903191)
> there's no intrinsic reason that the same company that gives away labour as OSS should also make the best complements to that OSS

There are no guarantees that they will provide the best complements to their own product, but the common sense is that they will. From a marketing perspective, I think it makes complete sense, especially when selling to enterprise customers.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @10:33AM (#18903691)
But they don’t.

The best complement for server side software is often being able to do it reliably, globally, redundantly, managed, on demand, and cheaply. The only three companies that can do that reliably as far as most customers are concerned are Amazon, Microsoft, and Google.

Re:AWS, MongoDB, and the Economic Realities of Open Source by ojosilva on Monday January 14, 2019 @02:14PM (#18905526)
I agree, I think Docker is an example on how to almost completely fail to take advantage of being first to market. Redhat, AWS, Google and others were quicker to monetize on docker (the runtime) than Docker the company.
Re:AWS, MongoDB, and the Economic Realities of Open Source by houseofzeus on Monday January 14, 2019 @02:29PM (#18905668)
Docker are actually an example of a pattern, one that also impacts MongoDB and many other companies. That pattern is that they intentionally branded the product and the project with the same name (in this case Docker) to help with slipstreaming on the community mindshare they were building.

The flip side of that which eventually comes home to roost though is that it means the two are easily confused . If I'm a customer and I can download X or buy X from you, and the two are virtually identical, you better have a damn good story as to what your value proposition over and above the project is.

Red Hat actually arguably only just got themselves out of this. Originally there was just Red Hat Linux, regardless of whether you paid them a cent. The split into Fedora (Core) - the free distribution - and RHEL - the enterprise distribution with paid support subscriptions - is a not insignificant part of why the company still exists today. This transition was not without controversy, and arguably created the space into which Canonical and Ubuntu emerged, but it was a necessary step to disambiguate the project and the thing people actually pay for with its own value prop and messaging around it.

It's somewhat surprising that so many of these companies proclaim they want to be the next Red Hat, but ignore the prior art for how that came to be.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @05:10PM (#18907015)
I don't see anything Mongo could have done differently. Even if Mongo were completely proprietary software, it wouldn't have affected AWS. They didn't use Mongo's code just emulated their API. That's basically the same thing that kicked off the entire PC industry -- clean room cloning BIOS.
Re:AWS, MongoDB, and the Economic Realities of Open Source by ojosilva on Monday January 14, 2019 @06:17PM (#18907492)
Emulating a propietary API would open up the door to litigation with uncertain outcome, generating distrust and bad press for Amazon. So not the same.
Re:AWS, MongoDB, and the Economic Realities of Open Source by samatman on Monday January 14, 2019 @07:20PM (#18907874)
This has already been settled in the courts: APIs are not subject to copyright and may be freely reverse engineered, provided the usual cleanroom methods are followed.
Re:AWS, MongoDB, and the Economic Realities of Open Source by dragos1984 on Tuesday January 15, 2019 @03:18AM (#18909562)
After the Google vs Oracle case i thought the courts decided the opposite of what you are saying: APIs are copyrightable and Google will have to pay aot of money for using them in Android.
Re:AWS, MongoDB, and the Economic Realities of Open Source by dragonwriter on Tuesday January 15, 2019 @03:37AM (#18909661)
> After the Google vs Oracle case i thought the courts decided the opposite of what you are saying

Are you posting from the future? Because it isn't after that case yet; Google plans to appeal (given that they filed for an extension to the 25th of this month) the latest Federal Circuit decision to the US Supreme Court and, if that doesn't succeed and end the case in Google’s favor, the next step would be a third trial in the District Court, followed—however that turns out—by another appeal by one side or the other to the Court of Appeals for the Federal Circuit, possibly another petition for en banc rehearing after that appeal, and potentially another appeal to the Supreme Court.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @06:35PM (#18907611)
The original PC BIOS was also proprietary.

Google did the same thing with Java. It’s up in the air how that will turn out.

Re:AWS, MongoDB, and the Economic Realities of Open Source by dragos1984 on Tuesday January 15, 2019 @03:20AM (#18909573)
Actually the courts already decided in Oracles favor, the only remaining thing to establish is how much money Google will have to pay.
Re:AWS, MongoDB, and the Economic Realities of Open Source by dragos1984 on Tuesday January 15, 2019 @03:20AM (#18909571)
Actuallt the courts already decided in Oracles favor, the only remaining thing to establish is how much money Google will have to pay.
Re:AWS, MongoDB, and the Economic Realities of Open Source by mr_toad on Monday January 14, 2019 @08:42PM (#18908220)
> as far as most customers are concerned

Probably true for the average punter, but we shouldn’t overlook the other players, like Alibaba, DigitalOcean, IBM, Vultr, Oracle, Linode and more.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Monday January 14, 2019 @09:05PM (#18908324)
A serious enterprise is not going to bet their cloud infrastructure on Linode. AWS offers a lot more than just a bunch of hosted VMs.

A serious CTO whose neck is on the line is not going to go with a small player.

To paraphrase an old saying.

“No one ever got fired for buying AWS”

For an MS shop, the same could be said for Azure.

Re:AWS, MongoDB, and the Economic Realities of Open Source by mr_toad on Tuesday January 15, 2019 @11:45PM (#18918287)
If you go with AWS because they have the best SLA, or GCE because they have better managed K8 offerings, then fine.

But going with AWS because ‘no-one ever got fired’ for it, or picking Azure because you play squash with a guy from Microsoft’s sales team is just lazy. Not that I’m saying it doesn’t happen.

Forbes and Gartner might ignore the other players, doesn’t mean we can’t be better informed.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Wednesday January 16, 2019 @06:47AM (#18920015)
Well, let’s look at where the phrase originated and how that turned out.

If someone had bought a mainframe IBM system in 1980 to run their COBOL system over their competitor, 40 years later, they could still buy a compatible system from IBM. It’s competitors - not so much.

On the other hand, idealism has its place, but when things hit the fan because of your choice of vendors, it’s a lot easier to justify a buying decision by saying the vendor was in the second quadrant of Gartner’s Magic Square.

Re:AWS, MongoDB, and the Economic Realities of Open Source by pas on Tuesday January 15, 2019 @03:12PM (#18914569)
more than VMs. yes, and that's the vendor lock in part.

sometimes it's okay though.

but AWS monoculture is not a bright future.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Tuesday January 15, 2019 @10:52PM (#18918109)
All of the services with no lock in

Elastic Cache - hosted Redis and Memcached

Aurora - compatible with MySQL and Postgres

RDS - hosted versions of Mysql, MariaDB, Sql Server, and Oracle.

Redshift - yes it uses a proprietary/columnar store engine but it is compatible with Postgres.

Etc.

But the bigger point is that you’re always locked into your infrastructure, do you think your CTO is going to move from their million dollar Oracle infrastructure because you used the Repository Pattern?

Re:AWS, MongoDB, and the Economic Realities of Open Source by pas on Wednesday January 16, 2019 @07:45AM (#18920316)
AWS has quite a few other solutions that you haven't mentioned that are not so portable.

I'm not advocating simply ignoring AWS's strengths because let's say Lambda/EBS/ELB/etc. is proprietary, but this is a very real, very simple risk. As AWS can, it will raise prices.

And sure, maybe it doesn't matter because you can always just fall back to using whatever you use on simple VMs, and AWS will always have some competition in the simple VM hosting space and VM prices will therefore will be low.

However, I'm on the opinion that institutional inertia will "kick in" (to use a rather bad figure of speech for something that is about as agile as a drum of molasses) and will simply let AWS rent-seek.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Wednesday January 16, 2019 @07:52AM (#18920348)
So you’re going to “move to the cloud” and just host a bunch of VMs.

Congratulations, you now have the worse of all worlds. You’re spending more than baremetal, you’re spending just as much on maintenance and management instead of letting someone else do the “undifferentiated heavy lifting” and your developers are moving slower than they would have if they took advantage of your cloud vendors offerings.

Win????

Re:AWS, MongoDB, and the Economic Realities of Open Source by pas on Thursday January 17, 2019 @08:47AM (#18930701)
You can't just "move to the cloud" by firing Ops people and giving an AWS account to your Devs.

Or, well, you can, but then don't forget to set your billing limit to infinity as well. Because AWS wants to make money.

Anyway, I'm not saying RDS/Aurora/etc. is bad, but eventually the heavy lifting will be available for anyone ( https://github.com/beekhof/rss-operator and similar projects ), and it's not like AWS likes to pay when they don't perform according to their SLA.

Re:AWS, MongoDB, and the Economic Realities of Open Source by scarface74 on Thursday January 17, 2019 @09:49AM (#18931104)
There is more to the cloud than “managed Kubernetes”.

While you can’t fire all of your ops you can reduce the headcount by a combination of managed services/servers, automation, outsourcing to managed service providers, and an auto healing fault tolerant infrastructure

Re:AWS, MongoDB, and the Economic Realities of Open Source by alittletooraph on Monday January 14, 2019 @11:41AM (#18904266)
> It's just that there's no intrinsic reason that the same company that gives away labour as OSS should also make the best complements to that OSS.

AWS's version will likely always lag on features, whether it's their Elasticsearch service or this new DocumentDB thing. So to continue the music industry analogy from the original article, sure Taylor Swift may or may not be able run the most reliable streaming service but she'll still get business if Spotify/Pandora only has covers of her songs.

Re:AWS, MongoDB, and the Economic Realities of Open Source by laurentl on Monday January 14, 2019 @04:37PM (#18906778)
A closer analogy would be “Spotify/Pandora cannot stream new albums for a period of X months” since AWS has the option to develop the missing features, and will if they’re requested by enough customers (AWS is extremely pragmatic when it comes to product roadmap). So, to strain the music analogy further: if you’re happy with the back catalog and you can wait a little bit to listen to the latest songs (say, while others test if they’re any good) then you don’t have to put up with the unreliable streaming service.

IIRC this strategy was tested by Jay-Z with little success. Taylor Swift also came back to Spotify...

Re:AWS, MongoDB, and the Economic Realities of Open Source by justicezyx on Monday January 14, 2019 @03:28PM (#18906160)
> Open source software is by definition commoditized.

I thought commodity means something that can be produced by many different companies without substantial differences in cost, quality, functionality etc.

Open source software usually is siganificant in their complexity and utility. Also they have strong gluing effect to customers' own code.

To say they are commodity in the sense that they are free of charge, seems not the right way of thinking them as commodity.

Re:AWS, MongoDB, and the Economic Realities of Open Source by greycol on Monday January 14, 2019 @05:02PM (#18906960)
You can't treat open source software as a commodity but you can treat any version of open source software as a commodity.

i.e. debian and ubuntu may not be interchangable commodities but ubuntu 16.04 from a torrent vs given from a friend vs downloaded from a mirror are interchangeable.

The services around opensource software such as troubleshooting or being able to spin up a server without having to supply anything but a password (and cash) are what makes a specific version differentiable, not who supplied the bits of that version. Since opensource is free and anyone can distribute it any 1 version is a commodity.