News for hackers. Stuff that matters.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by forkandwait on Thursday April 03, 2014 @02:48AM (#7521324)
Anybody know of a FreeBSD comparison?
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by kev009 on Thursday April 03, 2014 @03:53AM (#7521465)
+1 I'd love to see a FreeBSD kernel hacker chime in here.

ZFS enables some interesting things for pgsql:

* http://open-zfs.org/wiki/Performance_tuning#PostgreSQL - it seems like the primarycache setting prevents the double buffering problem that Linux' page cache has

* http://citusdata.com/blog/64-zfs-compression

I run pgsql on FreeBSD/ZFS and have no complaints but am not taxing the system.

Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by sickpig on Thursday April 03, 2014 @05:21AM (#7521743)
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by ksec on Thursday April 03, 2014 @04:50AM (#7521652)
I love ZFS, but Oracle is holding it up which is very annoying.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by kev009 on Thursday April 03, 2014 @05:28AM (#7521765)
How do you mean? I trust OpenZFS more and in fact would consider it negligent if Oracle wasn't cherry picking OpenZFS bug fixes. Several original Sun engineers including ZFS co-founder Matt Ahrens are involved with OpenZFS.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by bcantrill on Thursday April 03, 2014 @06:06AM (#7521871)
Yes, as I have elaborated upon at length[1], the ZFS engineers have long-since left Oracle -- and the open community's ZFS (that is, OpenZFS) has become the ZFS of record.

One clarification: Oracle can't actually cherry-pick back OpenZFS bug fixes because they are (ironically) violating the CDDL by not making available source code. This isn't an issue for the code for which they hold copyright -- but that doesn't include any of the bug fixes and features that we've seen in OpenZFS since 2010. And yes, it is absolutely negligent, but of a different sort than you intended...

[1] http://www.youtube.com/watch?v=-zRN7XLCRhc

Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by kev009 on Thursday April 03, 2014 @06:22AM (#7521915)
Cheers Bryan, that's a great one of your talks and thanks for the interesting licensing comedy.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by octotoad on Thursday April 03, 2014 @05:35AM (#7521779)
Do you mean they're holding back progress? With OpenZFS on the scene, it's highly likely that the original Sun/Oracle implementation will become irrelevant to everyone apart from users of Oracle's Solaris releases.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by treenyc on Thursday April 03, 2014 @03:57AM (#7521478)
FreeBSD has something like

SHMMAXPGS, SHMMAX in postgresql.conf

in the

sysctl.conf kern.ipc.shmall kern.ipc.shmall

Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by DrJokepu on Thursday April 03, 2014 @04:29AM (#7521571)
Not relevant since PostgreSQL 9.3 as PostgreSQL now uses Posix shared memory / mmap rather that System V.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by kev009 on Thursday April 03, 2014 @04:08AM (#7521521)
I don't think this has any direct influence on performance.

It was necessary to increase the default limits for larger shared_buffers, etc on pgsql prior to 9.3 where SysV shared memory was used, but this was common to many *nix operating systems.

Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by treenyc on Thursday April 03, 2014 @08:46AM (#7522409)
thanks a lot really. I have being use Linux for a while now. Thanks for the update.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by bifrost on Thursday April 03, 2014 @03:22AM (#7521397)
Aside from the NUMA stuff, the disk buffer issue probably depends on if you're using ZFS or not.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by tankenmate on Thursday April 03, 2014 @05:03AM (#7521692)
And also whether the kernel is reporting the true block size of the device; xref advanced format drives (what the drive reports and what the drive does can be two different things), SSDs (minimum write size is typically much bigger than the reported block size), SANs. The true underlying block size can sometimes be determined by benchmarking the latency of different write sizes and also unaligned writes of different sizes.
Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by ams6110 on Thursday April 03, 2014 @02:41PM (#7525054)
Dragonfly is probably the best BSD to run for database performance.

http://www.dragonflybsd.org/performance/

Re: Subtly Bad Things Linux May Be Doing To PostgreSQL by profquail on Saturday April 05, 2014 @10:28PM (#7539431)
That chart is 18 months old. FreeBSD 10 got a number of SMP-related improvements (and some for ZFS as well, if I'm not mistaken). It'd be interesting to see an up-to-date comparison with FreeBSD 10 (and maybe 11-CURRENT), DragonFlyBSD 3.6, and NetBSD 6.1 (and maybe a couple of Linux distros for good measure).