News for hackers. Stuff that matters.
Re:New EC2 Instance Type - The Cluster GPU Instance by AngryParsley on Monday November 15, 2010 @04:26AM (#1905769)
This is cool, but you know what would be even cooler? Instances with SSD storage. It's so annoying to have database queries run an order of magnitude faster on my MacBook Air than on a cloud server.

I don't know of any major provider that offers SSD instances. It really is an untapped market.

Re:New EC2 Instance Type - The Cluster GPU Instance by PStamatiou on Monday November 15, 2010 @04:32AM (#1905779)
Re:New EC2 Instance Type - The Cluster GPU Instance by StavrosK on Monday November 15, 2010 @05:13AM (#1905849)
I don't know if they use SSDs, but Linode's London servers are absolutely screaming fast.

Linode: Timing buffered disk reads: 230 MB in 3.01 seconds = 76.44 MB/sec

My local X-25M: Timing buffered disk reads: 246 MB in 3.02 seconds = 81.48 MB/sec

This would suggest they are using SSDs (or fast RAID? I'm not sure if this benchmark is sequential access). I get comparable performance for the Georgia data center, but it varies greatly there, so I'm not sure what's going on.

EDIT: Sorry, apparently I can't tell my sde from my sda. My actual SSD performance is:

Timing buffered disk reads: 564 MB in 3.01 seconds = 187.47 MB/sec

So yes, disregard everything above.

Re:New EC2 Instance Type - The Cluster GPU Instance by codedivine on Monday November 15, 2010 @05:20AM (#1905860)
76MB/s is quite common for regular hard drives. The great advantage of SSDs is not necessarily sequential speed but rather random IO.

As for your X25-M, do you have TRIM enabled? Your read speeds are consistent with a used-state SSD without TRIM.

Re:New EC2 Instance Type - The Cluster GPU Instance by StavrosK on Monday November 15, 2010 @05:23AM (#1905864)
I am using TRIM now (I assume), as I'm running the Ubuntu 10.10 kernel, which supports it on ext4. Before this, I was running 10.04, which didn't support trim. I'm not sure if I should clone the drive and reformat to get more speed, and I'm also not sure if there are alignment issues (I followed Ted Ts'o's advice on setting that up)...
Re:New EC2 Instance Type - The Cluster GPU Instance by codedivine on Monday November 15, 2010 @05:38AM (#1905881)
Sorry if you have already done all this, but do you know if you are using the G1 or G2 X25-M? G1 doesn't have trim. G2 supports TRIM as long as you are not using the old firmware. So might be worth checking your firmware etc.?

Btw here is hdparm reading for my Western Digital Caviar Black (regular hard disk) just to give you an idea: 318 MB in 3.01 seconds = 105.56 MB/sec

Re:New EC2 Instance Type - The Cluster GPU Instance by StavrosK on Monday November 15, 2010 @05:41AM (#1905884)
I did upgrade my firmware a month ago, but I'm not sure which version I have, I'll check. However, now that you mention it, I do remember the disk doing 200ish mb/sec, maybe this was a fluke. It's almost empty, I use 20 out of the 160 gb, so I don't think it's a matter of allocated space...
Re:New EC2 Instance Type - The Cluster GPU Instance by bdonlan on Monday November 15, 2010 @10:42AM (#1906586)
Note that the performance benefits for TRIM only affect write performance, _not_ read performance.
Re:New EC2 Instance Type - The Cluster GPU Instance by bdonlan on Monday November 15, 2010 @10:42AM (#1906580)
Linode doesn't use SSDs (yet) - the founder has been spotted on their IRC channel in the relatively recent past mentioning the cost/performance isn't where they want it yet.

hdparm only does sequential reads, so don't expect a night-and-day difference between SSDs and rotating disks. Plus that benchmark reads out of the disk (buffer) cache, so you might really testing your memory speed.

Re:New EC2 Instance Type - The Cluster GPU Instance by Nate75Sanders on Monday November 15, 2010 @05:18AM (#1905856)
The 1TB SATA non-SSD drive in my server at work clocks in at 105.33MB/s for "hdparm -t"

I doubt they're using SSDs.

Re:New EC2 Instance Type - The Cluster GPU Instance by StavrosK on Monday November 15, 2010 @05:20AM (#1905859)
Ah, it's probably a sequential benchmark then. For what it's worth, the London linode feels faster than my desktop (which has an ssd).
Re:New EC2 Instance Type - The Cluster GPU Instance by rbanffy on Monday November 15, 2010 @07:04AM (#1905986)
> I don't know if they use SSDs, but Linode's London servers are absolutely screaming fast.

I think it's more likely they are using a high performance shared storage box. Those are really fast and reliable. The only reason I would use disks (whether SSDs or spinning metal) would be for speed. If, say, a storage box has 200 servers hanging from it and all 200 decide to go nuts with disk access you won't be able to sustain anything near 76 MBps per box.

As for the storage boxes themselves, they usually employ piles of ECC RAM, specialized network and disk controllers, SSDs, fast and small disks, larger and slower disks and keep moving data around trying to guess the optimal positioning to give you the best possible performance under your varying workload. It must be really cool to design one.

Re:New EC2 Instance Type - The Cluster GPU Instance by mike-cardwell on Monday November 15, 2010 @06:30AM (#1905941)
FWIW, my Linode is in the NJ DC:

Timing buffered disk reads: 142 MB in 3.00 seconds = 47.28 MB/sec

Re:New EC2 Instance Type - The Cluster GPU Instance by JshWright on Monday November 15, 2010 @08:24AM (#1906143)
Linode uses local storage on each host. Fast conventional drives in a RAID-10 array.
Re:New EC2 Instance Type - The Cluster GPU Instance by rmc on Monday November 15, 2010 @06:47AM (#1905962)
Get an instance with a lot of memory and the use a tmpfs?
Re:New EC2 Instance Type - The Cluster GPU Instance by prodigal_erik on Monday November 15, 2010 @04:46AM (#1905810)
They would have to track wear and charge for the depreciation of a local SSD, since every newly started instance is going to want to overwrite much of the contents. It might make more sense to have SSD space available via SAN to any of your instances.
Re:New EC2 Instance Type - The Cluster GPU Instance by flyt on Monday November 15, 2010 @04:29AM (#1905774)
Give it time. SSD's are entirely too expensive today for this kind of deployment.
Re:New EC2 Instance Type - The Cluster GPU Instance by mrb on Monday November 15, 2010 @05:13AM (#1905850)
SSDs are cheap in terms of $/IOPS. In fact they are about a hundred times cheaper than HDDs (Crucial C300 128GB: $250 for 50k IOPS vs. entry-level 7200RPM HDD: $60 for 120 IOPS or so).

People, stop assuming that $/GB is the only metric that matters.

Re:New EC2 Instance Type - The Cluster GPU Instance by wwortiz on Monday November 15, 2010 @01:56PM (#1907362)
I wonder if $/GB matters when people are selling VMs (like say linode), I don't know how many Virtual Machines are put into one server but if you are doing 16gb per VM and depending on the RAID usage as well it might start to add up.

I also don't know if this is still a problem but there was a worry about limited writes on SSDs and if normal harddrive lifetimes are greater than that of an SSD by a significant amount I could see why it would be a problem.

Re:New EC2 Instance Type - The Cluster GPU Instance by haribilalic on Monday November 15, 2010 @04:37AM (#1905791)
Why can't they offer SSD instances at a higher price than non-SSD instances? Those that want or need the extra performance can pay for it just as they're paying for other niche instances already.