News for hackers. Stuff that matters.
Re:Wal-E: Continuous Archiving for Postgres by sdrothrock on Sunday February 05, 2017 @07:37PM (#13575647)
> The best part is, you'd do a COMMIT and it would essentially block until the data was in HDFS.

Do you have any problems with freezes or timeouts during high loads?

Re:Wal-E: Continuous Archiving for Postgres by ninkendo on Sunday February 05, 2017 @08:05PM (#13575773)
We had freezes/timeouts only when the disk filled up, other than that it was pretty good. Simply writing the data to HDFS is a lot cheaper operation than committing the data to a local database, so in practice it was a lower latency than having a "real" standby server that committed logs to disk. (We saw about a 3x TPS gain over a dedicated standby in synchronous mode.)

Also the way I see it, turning on 'synchronous_standby_names' was a nice added safety guarantee, in practice leaving the hdfs receiver asynchronous would be a reasonable alternative if you're confident things will work as you expect.