News for hackers. Stuff that matters.
Re:MongoDB Is Raising Another $100M by gfodor on Friday January 09, 2015 @07:04PM (#8865254)
psql has read only streaming slave replication with a hot standby failover, in the box.
Re:MongoDB Is Raising Another $100M by mnutt on Friday January 09, 2015 @07:22PM (#8865307)
Sure, but the base_backup process is painful enough to make it non-trivial. It's not like you can just bring up a new postgres instance, point it at an existing primary and say "catch up and start replicating".

Replication has certainly gotten much better in the past few years, though.

Re:MongoDB Is Raising Another $100M by eknkc on Friday January 09, 2015 @07:37PM (#8865343)
Yeah.. which takes 25 people and 45 days to set up /s

Mongodb literally has a 1-line command to add a replica set member and it works. This is still a huge advantage.

Re:MongoDB Is Raising Another $100M by gfodor on Friday January 09, 2015 @08:16PM (#8865442)
That's bs. With wal-e it took a few hours tops to set up a basic master-slave system from scratch if you didn't know what you're doing. I'd have to imagine it's easier now. With proper automation adding a replica should be as simple as booting a machine and running a script or two.

I don't care either way I just use RDS and don't worry about it. (You can add replicas in one click with RDS.)

Re:MongoDB Is Raising Another $100M by threeseed on Friday January 09, 2015 @10:15PM (#8865754)
I can't tell from the documentation whether wal-e supports non-cloud based synchronisation (https://github.com/wal-e/wal-e). There's no example listed there.

And if you think that is as simple as MongoDB's replica sets then frankly you are crazy.

Re:MongoDB Is Raising Another $100M by takeda on Saturday January 10, 2015 @12:09AM (#8865983)
Wal-E is a backup solution, and has something that Mongo doesn't it is capable of backing up every transaction and restoring the database state at any point in time. Because of its nature it can be used for replication.

Wal-E was written for use in cloud which has its own challenges, but if you want to run in your data center the closest thing is Swift in OpenStack.

As for Mongo, my company is currently using it, and I wouldn't say it's any easier especially when you try to use it in public cloud, when you no longer have guarantees that the instance you set up won't be terminated and recreated in different AZ. There are plenty of challenges.

I'm currently working on convincing other teams to drop using Mongo and instead make queries directly to Postgres which is our authoritative source of data. The idea was to simplify our infrastructure, and I was not expecting much difference in performance but oh boy. In all of my POCs that I did so far PG is beating Mongo that makes you feel sorry for it. Both in performance (you need to understand what you're doing and use right types, indices and queries) and data size (after moving, the data is much smaller so it no longer requires being distributed, and also the instances can be much smaller).

Re:MongoDB Is Raising Another $100M by tracker1 on Sunday January 11, 2015 @12:11AM (#8869105)
Mongo is perfectly capable of point in time restores... in fact Mongo corp has a SaaS that does this... I know of several who have done the same on their own. There's been plenty of work in side-channel events with Mongo's log shipping system.

Perhaps you can point to a relatively simple walkthrough to setup PostgreSQL with plv8 for replication (with an easy promotion of a slave to master), that doesn't take a commercial support license...

Everything I've seen seems incredibly convoluted and more difficult than say MS-SQL, MongoDB, RethinkDB, ElasticSearch or several other databases at data replication and spinning up new nodes, or handling a primary failure.

Also, most of my work with Mongo has performed very well, if your data is a good fit, which I will admit it isn't all a good fit. Honestly, I'd rather use pgsql with plv8 over mongo, or elasticsearch, or ms/azure-sql... The support costs and my time are important to me, and better spent working on architecture or development. If I can make an operations level decision that works well enough, or is easier to scale then the development time is almost a wash.

Re:MongoDB Is Raising Another $100M by angrybits on Friday January 09, 2015 @08:20PM (#8865453)
It's really not, the thing that makes a piece of software successful is not how many lines of bash it takes to "scale". It's how hard it is to need to scale. You're worried about the wrong thing.
Re:MongoDB Is Raising Another $100M by craigching on Friday January 09, 2015 @09:35PM (#8865654)
Replication isn't about scaling, it's about HA. And MongoDB's replication is dead simple to setup. I am waiting for PGSQL to catch up in that regard, they are working on it and making good progress.

If you need scaling in MongoDB, you're looking at replica sets combined with sharding. Not all workloads, as you rightly point out, need to scale from the get-go, but there are an awful lot that need HA.

Re:MongoDB Is Raising Another $100M by tracker1 on Sunday January 11, 2015 @12:29AM (#8869149)
Thank you... This was kind of my point... I will note that if you are in a situation with very heavy read usage, then replication does give you scaling regarding that. Again, my use case was for a classifieds site, where roughly have the page views are search results.
Re:MongoDB Is Raising Another $100M by eknkc on Friday January 09, 2015 @09:53PM (#8865697)
Who said anything about scaling? I run simple low utilization services on a replica set because of high availability. Replication only provides secondary reads in terms of scaling and that's not the point. Actual scaling comes from sharding (partitioning of data).