News for hackers. Stuff that matters.
Re:Disaster: MySQL 5.5 Flushing by sc68cal on Sunday September 18, 2011 @04:39PM (#3011201)
Are you running an equivalent hardware setup? Similar to:

>Hardware: HP ProLiant DL380 G6, with 72GB of RAM and RAID10 on 8 disks.

Playing devil's advocate - there is no proof that PostgreSQL does not have any teething problems on high capacity hardware either.

Re:Disaster: MySQL 5.5 Flushing by bretthoerner on Sunday September 18, 2011 @05:21PM (#3011296)
> Are you running an equivalent hardware setup? > there is no proof that PostgreSQL does not have any teething problems on high capacity hardware either

At Disqus we run Postgres on even larger boxes without pauses described here. We would have (had to) migrate off long ago if this were par for the course.

Re:Disaster: MySQL 5.5 Flushing by gleb on Sunday September 18, 2011 @06:58PM (#3011521)
There is similar problem in Postgres as well.

Not nearly as bad in magnitude, and with some shared responsibility with Linux and file system code (since PG relies of filesystem's caching). Greg Smith talked about it in some detail during PGWest 2010. One of his customers had long stalls in production and Greg worked out how to reproduce and explain them.

He had some patches he was planning for Postgres 9.1, not sure if they went in.

Re:Disaster: MySQL 5.5 Flushing by spudlyo on Sunday September 18, 2011 @07:08PM (#3011539)
Is your database extremely write heavy? You don't usually see this problem in a more balanced read/write workload. Postgres has in the past suffered from stalls and lockups that can happen at checkpoint intervals, but it appears they mostly happen for seconds rather than minutes.
Re:Disaster: MySQL 5.5 Flushing by sciurus on Sunday September 18, 2011 @11:59PM (#3012170)
The answer is that yes, Postgres can have a similar problem.

http://notemagnet.blogspot.com/2008/08/linux-write-cache-mys...

Re:Disaster: MySQL 5.5 Flushing by moe on Sunday September 18, 2011 @06:23PM (#3011453)
That's not "high capacity", it's a mid-range box.

The mentioned spec can be had for roughly $7000 USD, depending on CPU.

Re:Disaster: MySQL 5.5 Flushing by pointyhat on Sunday September 18, 2011 @05:06PM (#3011250)
The issue is x86/x64 being a turd. Throughput of just about everything drops when you go over the 36Gb boundary for some reason. I have no idea why. It can drop by as much as 30%. This is from experience operating VMware on the physically the same type of kit (except with FC SAN / NetApp).

I'd personally rather buy high end SPARC64 kit which has linear performance scalability but we all know what happened to Sun, plus it doesn't run Windows anyway :( whimpers a little

Re:Disaster: MySQL 5.5 Flushing by jeremyw on Sunday September 18, 2011 @05:57PM (#3011383)
Be careful of your NUMA boundaries. 20-30% is exactly the cross-bank access cost.
Re:Disaster: MySQL 5.5 Flushing by spudlyo on Sunday September 18, 2011 @07:12PM (#3011547)
That's what I thought too. There are a lot of weird problems that can happen due to NUMA architecture issues. Reading the numactl for me really drives home just how much I don't understand it.

http://www.linuxmanpages.com/man8/numactl.8.php

Re:Disaster: MySQL 5.5 Flushing by pointyhat on Sunday September 18, 2011 @06:05PM (#3011402)
That's what I was thinking. Need some analysis on it really. We throw money at the problem at the moment and it goes away :)
Re:Disaster: MySQL 5.5 Flushing by zwischenzug on Sunday September 18, 2011 @05:54PM (#3011375)
I've seen DBs run on 128G machines on x6 and have no experience of such problems. Do you have a link or hard evidence of this?

I have seen throughput issues on VMWare machines (and false reporting on standard linux utilities, eg "time" output and various other issues that make me distrust it for performance-sensitive software), but don't know if this is to do with 128G machines; usually it's to do with contention on one network card handling all traffic to disks.

Re:Disaster: MySQL 5.5 Flushing by trafficlight on Sunday September 18, 2011 @05:31PM (#3011320)
I haven't heard/experienced the 36 GB thing since I don't run anything that big right now. Are you aware of any websites or blog posts that talk about it?
Re:Disaster: MySQL 5.5 Flushing by pointyhat on Monday September 19, 2011 @08:47AM (#3013291)