News for hackers. Stuff that matters.
Re:New EC2 Standard Instances and Price Reductions by cperciva on Thursday November 01, 2012 @02:30AM (#4726452)
Always nice to see new options, but I wish Amazon hadn't dropped the ephemeral disk. Quite apart from the issue of surviving EBS failures, ephemeral disks are wonderful for swap space -- since the lifetime of swap exactly matches the lifetime of ephemeral disks. I even have a startup script in FreeBSD which autoconfigures swap space striped across a few GB of ephemeral disks.
Re:New EC2 Standard Instances and Price Reductions by saurik on Thursday November 01, 2012 @10:37AM (#4727719)
It is quite possible that this is specifically why these new instance types can exist: as a lot of users don't use the ephemeral drives at all, even for swap, you can now build a new set of servers that are just CPUs and network cards, getting rid of the large disk drive; some tradeoff has to be made to increase some of the stats but not the price, and saying it is a shame that they didn't include everything seems to then miss the point.
Re:New EC2 Standard Instances and Price Reductions by csense on Thursday November 01, 2012 @04:15PM (#4729477)
> some tradeoff has to be made to increase some of the stats but not the price

I disagree. According to Wikipedia, it's been six years since EC2 launched. Since 2006-equivalent hardware is much cheaper in 2012 due to Moore's Law, (or alternatively the specs you can buy with a given number of dollars in 2012 is much better than it was in 2006), and since the original EC2 machines have probably been in service long enough to generate sufficient revenue to recover their upfront investment and make a profit, it wouldn't be unreasonable for Amazon to start retiring those old machines and use the better price/performance point of new hardware as a business justification to give customers some combination of price breaks and spec upgrades.

Re:New EC2 Standard Instances and Price Reductions by saurik on Friday November 02, 2012 @08:07AM (#4732228)
That would make sense across the board; in this case, you have to just compare the price point between different current offerings; these new instance types are similarly priced yet with higher specs in some areas, and I will argue that it is a tradeoff against the disks.

If you feel like Amazon should be cheaper overall due to Moore's law (and remember: they have lowered their prices numerous times since they launched on everything from hardware to bandwidth), then the price of the things we are comparing to would also be cheaper (as these are all just virtualized subsets of larger machines).

Re:New EC2 Standard Instances and Price Reductions by JoachimSchipper on Thursday November 01, 2012 @02:33AM (#4726461)
Stupid question: is that in the article, or..? I seem to have missed it.
Re:New EC2 Standard Instances and Price Reductions by cperciva on Thursday November 01, 2012 @02:34AM (#4726464)
Not in the article. On the EC2 website: http://aws.amazon.com/ec2/instance-types/
Re:New EC2 Standard Instances and Price Reductions by nilsbunger on Thursday November 01, 2012 @02:42AM (#4726481)
Specifically, the new instances (m3.*) are only available with ebs. There is probably a technical reason for this - eg maybe they move these bigger instances around to different servers so they can't be on local disk? Would love to know why...
Re:New EC2 Standard Instances and Price Reductions by cperciva on Thursday November 01, 2012 @02:48AM (#4726494)
I'm guessing that Amazon has wanted to phase out ephemeral disk on non-HPC instances for a long time, since it costs them money and most people don't use it; and the availability of EBS-optimized instances and provisioned-IOPS disks was what they needed to satisfy the people who insisted that ephemeral disk was the only way to get reliable I/O performance.

And I'm sympathetic to that argument where large amounts of disk are concerned... but I do wish we could have a small amount of ephemeral disk to be used for swap space.

Re:New EC2 Standard Instances and Price Reductions by kelnos on Thursday November 01, 2012 @04:22PM (#4729513)
I think there's a reliability argument to be made as well. Most (all?) of the EC2 outages and partial outages over the past year or so have had their root cause somewhere in EBS. It's also why I hesitate to touch ELBs or RDS, since they both rely on EBS.
Re:New EC2 Standard Instances and Price Reductions by raverbashing on Thursday November 01, 2012 @05:08AM (#4726723)
My guess is that ephemeral disks were dropped because of too many people losing data on them.

Not because of a fault, but because they don't know instance disks are ephemeral.

Permanent storage as a default is a saner default as well.

Re:New EC2 Standard Instances and Price Reductions by cynicalkane on Thursday November 01, 2012 @10:51AM (#4727791)
I think it's moot. For heavy users, the use case for ephemeral disk is better served by their I/O instances. For light users, I think Amazon is betting that EBS is 'stable enough' by now. If you really don't like EBS, there's always the old instances, Amazon RDS, Amazon DynamoDB...
Re:New EC2 Standard Instances and Price Reductions by newhouseb on Thursday November 01, 2012 @04:21AM (#4726636)
Yeah, applications servers (read: web front-ends) can easily run entirely from memory, so it's annoying to have the rest of the OS dependent on EBS when it really needn't be. (Although to be honest I'm not aware how easy or hard it is to pull out the hard disk from a booted instance without customizing the kernel).
Re:New EC2 Standard Instances and Price Reductions by paulsutter on Thursday November 01, 2012 @03:58AM (#4726602)
All of the disk performance benchmarks (iops, throughout, buffered vs unbuffered) I ran on ephemeral disks matched exactly the performance of ebs. That could be a coincidence that my tests ran only on machines without local disk, but more likely ephemeral disk was really just EBS in most cases. So it always seemed like a silly or even misleading product to me.
Re:New EC2 Standard Instances and Price Reductions by jspthrowaway on Thursday November 01, 2012 @06:27AM (#4726890)
Ephemeral is definitely not EBS, as its I/O does not contribute to saturating an instance's network connection (I've tested that). EBS has a ceiling for throughput (the instance's network throughput) and competes with your other network traffic, which is interesting for database workloads for obvious reasons. In addition, every single benchmark I've seen run reports ephemeral behaving very differently from EBS.

As ephemeral disappears when you stop an instance (presumably, when the system is given the opportunity to relocate your instance to another machine), I've always suspected that ephemeral storage was part of local disks on the virtual host's chassis -- as opposed to a SAN or other kind of network-attached storage. As such, you probably end up with the same unpredictable performance you find in all virtualized resources, since it is very unlikely that Amazon is giving you your own storage.

Before benchmarking ephemeral storage you have to pre-warm it, which might have contributed to your findings. Ephemeral is worlds better than EBS, particularly in outage scenarios; if I could convince everybody on planet Earth to stop using EBS, it would be a noble cause.

Re:New EC2 Standard Instances and Price Reductions by paulsutter on Thursday November 01, 2012 @08:01AM (#4727060)
Hmm, I have been told by Amazon and confirmed in my testing that EBS is immune to the network throttle (unlike machismo to machine tcP, s3, etc)
Re:New EC2 Standard Instances and Price Reductions by jspthrowaway on Thursday November 01, 2012 @08:40AM (#4727155)
It's not a throttle, it's the "physical" capacity of the "interface". If you're on an instance with gigabit connectivity and you're doing 1 Gb/s of EBS I/O, other network chatter will suffer, probably fairly dramatically. That's why the high-I/O instances have 10 gigabit connectivity, as I understand it.

Happy to be proven wrong but this is based on a year or so of experience dealing with EBS. You can't see the EBS traffic in your tools (at least that I've been able to find), which complicates things.

It's all kinds of different on VPC instances, therefore I suspect the network interface model -- and possibly EBS connectivity -- is different on those. So, who knows? I'd kill for Amazon to be more forthcoming here so I could understand the infrastructure running my fleet, but, I don't and they aren't.

Re:New EC2 Standard Instances and Price Reductions by windsurfer on Tuesday November 06, 2012 @08:11AM (#4748188)
Hey, you got hellbanned for posting on this thread: http://news.ycombinator.com/item?id=4743954
Re:New EC2 Standard Instances and Price Reductions by cperciva on Thursday November 01, 2012 @04:06AM (#4726613)
I've never seen ephemeral disks die during an EBS outage. Also, they don't cost anything for I/Os.