News for hackers. Stuff that matters.
Re:Everpix was great. This is how it died by rhizome on Tuesday November 05, 2013 @02:15PM (#6677378)
From the sounds of it, what doomed them was pricing too low in a way that made it impossible to create higher tiers of service, and, perhaps most importantly, using AWS for everything. AWS bills monthly, so if in fact they were running a $35k/mo bill there, a HUGE refactor was passed by. But then again, startups don't hire sysadmins anymore.
Re:Everpix was great. This is how it died by anigbrowl on Tuesday November 05, 2013 @04:48PM (#6678616)
Even at 35k/mo, that's 420k/year. That seems reasonably low to me (in the sense of a fundamental operating expense, not in terms of the going rate for hosting, which I have no clue about). By contrast, look at their people costs:

Total Salaries (between 6 people) $1,168,710.45

Total Payroll $1,298,819.67

Total Personnel Costs $1,411,513.53

That's about 10x their hosting expenses. Even if they had free hosting it seems like it would only have kept them going for another 2-3 months.

Re:Everpix was great. This is how it died by sameer_sundresh on Tuesday November 05, 2013 @06:59PM (#6679476)
I don't know why the article list salaries, payroll and personnel costs as separate numbers like that. Payroll includes salaries, and personnel costs includes payroll.
Re:Everpix was great. This is how it died by jliptzin on Tuesday November 05, 2013 @09:57PM (#6680293)
Is this payroll over one year? If so, that's absurd. No one should be making $200k+ in salary at a startup that still has yet to turn a dime of profit. Just shaving 10% off that number would have covered their AWS costs for another 3 months.
Re:Everpix was great. This is how it died by sameer_sundresh on Wednesday November 06, 2013 @05:50AM (#6682021)
The totals are all over 2+ years, not per year.
Re:Everpix was great. This is how it died by ameen on Wednesday November 06, 2013 @07:48AM (#6682398)
Still higher for a company with paltry traction and no hockey stick growth. Weren't the employees (including you) compensated with equity?
Re:Everpix was great. This is how it died by strelok1 on Tuesday November 05, 2013 @07:02PM (#6679496)
They were paying themselves nice salaries weren't they.
Re:Everpix was great. This is how it died by TylerE on Wednesday November 06, 2013 @12:18PM (#6683801)
We support 4x their number of paying customers with an ANNUAL server bill that is ~half their MONTHLY bill.
Re:Everpix was great. This is how it died by emn13 on Tuesday November 05, 2013 @05:39PM (#6678983)
But it wasn't necessarily scalable from a business perspective, and that might not have been attractive to the investors they needed. Especially if it's true their pricing was low.
Re:Everpix was great. This is how it died by thatthatis on Tuesday November 05, 2013 @03:43PM (#6678133)
I think the relevant standard should be: focus on the core of your business, outsource everything else.

If you are a photo backup company, storage is (or at least should be) part of your core.

It seems like they tried to take the heroku route, repackage aws services with premium software and sell it for a premium. But forgot to charge the premium end user price.

Re:Everpix was great. This is how it died by ghaff on Tuesday November 05, 2013 @04:04PM (#6678283)
Amazon regularly features SmugMug at their conferences and in case studies. I haven't looked at the specifics recently but they basically went all-AWS. (SmugMug is also a bit different from your typical consumer photo site but they are a photo storage and sharing company.)
Re:Everpix was great. This is how it died by rhizome on Tuesday November 05, 2013 @06:12PM (#6679190)
Since they are a featured customer, they may also get price breaks.
Re:Everpix was great. This is how it died by thatthatis on Tuesday November 05, 2013 @06:52PM (#6679429)
I don't believe smugmug is a freemium service, are they?
Re:Everpix was great. This is how it died by dublinben on Tuesday November 05, 2013 @10:18PM (#6680390)
Nope, their lowest tier is $5/mo.

http://www.smugmug.com/features

Re:Everpix was great. This is how it died by United857 on Tuesday November 05, 2013 @02:26PM (#6677472)
Correct me if I'm wrong, but doesn't Dropbox use AWS? (Or at least did until recently.) The two services' pricing (on a per GB basis) is within the same ballpark.
Re:Everpix was great. This is how it died by rhizome on Tuesday November 05, 2013 @02:36PM (#6677567)
Dropbox has received a quarter of a billion dollars in funding.
Re:Everpix was great. This is how it died by nakedrobot2 on Tuesday November 05, 2013 @02:46PM (#6677645)
According to Drew Houston at Websummit last week, they haven't spent any of that money.
Re:Everpix was great. This is how it died by rhizome on Tuesday November 05, 2013 @02:55PM (#6677743)
So all of their acquisitions and burn has come from (crunchbase caveat) ~7MM? There's some missing pieces to be sure, but suffice it to say that having that much cash in your back pocket allows a different set of considerations.
Re:Everpix was great. This is how it died by emdowling on Tuesday November 05, 2013 @03:26PM (#6677973)
Drew said the same thing at TC Disrupt in SF this year. Reading between the lines: All the acquisitions and ability to pay 300+ staff without needing to touch a massive $250 million pot of money is basically telling the market (eg: Box): "We can play the enterprise game very well and have the revenue to prove it"
Re:Everpix was great. This is how it died by driverdan on Tuesday November 05, 2013 @10:11PM (#6680362)
I'm sure Dropbox gets better volume pricing than Everpix did.
Re:Everpix was great. This is how it died by aespinoza on Tuesday November 05, 2013 @02:22PM (#6677442)
Do you think they were better off by having their own servers ? (Honest question we use AWS and Rackspace, and we feel the pain of Monthly bills as well).
Re:Everpix was great. This is how it died by autarch on Tuesday November 05, 2013 @02:29PM (#6677515)
This should be fairly easy to price out, right?

I suggest you start by simply comparing the cost of dedicated hosting-provided hardware. This is the middle ground between owning your own stuff and something like AWS.

Pricing out the cost of owning your own servers can be tricky since you need to account for a number of factors:

* Initial cost of hardware - don't forget to include things like network switches, remote console devices, etc. - you may also want to buy something like a remotely accessible power switch so you can forcibly reboot machines

* Rack space costs

* Bandwidth costs

* Sysadmin time to manage the hardware (you already need a sysadmin to manage things like backups, logging, etc.)

* On-site remote hands if your rack host is not physically near your sysadmin

But regardless, I'm pretty sure that _anything_ ends up being cheaper than AWS once you get beyond a fairly small number of servers. The big advantages of AWS are integration with other services (storage, load balancing, etc.) and the ability to spin many machines up and down very quickly.

However, if you can tolerate waiting a day or so to provision new servers, dedicated hosting-provided hardware is almost certainly going to be quite a bit cheaper.

You could also compare this to something like Linode. Again, you lose the ability to provision new machines almost instantly, but they are pretty quick to bring up new machines (minutes, not hours or days). They also have a number of nice integrated services like backups.

Finally, you can also do some sort of hybrid setup where you have core stable services on dedicated machines but still spin up AWS instances to deal with bursty computation needs.

Re:Everpix was great. This is how it died by dmourati on Tuesday November 05, 2013 @04:00PM (#6678256)
I did this math at Eye-Fi, a competitor of sorts to Everpix. What I learned, is the answer to whether to build or buy is the classic: "it depends". The driving factor? Data retention policy. The one move Amazon made during my analysis that had a huge shift in the calculus was to introduce Glacier.

My takeaway, the economics of a lifetime storage offering are very difficult to achieve. Glacier changes the rules by altering the SLA for data access to make the money work out.

Re:Everpix was great. This is how it died by girvo on Tuesday November 05, 2013 @10:50PM (#6680542)
Eye-Fi is awesome. <3
Re:Everpix was great. This is how it died by rpedela on Tuesday November 05, 2013 @03:07PM (#6677837)
If you just use EC2, no EBS, and reserved pricing then AWS is just as cheap as other providers if not cheaper. It is all the nice features that make it expensive. S3 is pretty damn cheap too.

Of course, raw hosting costs are only part of the calculation. You have to include sysadmin time and salary.

Re:Everpix was great. This is how it died by autarch on Tuesday November 05, 2013 @03:38PM (#6678080)
You can't really compare EC2 sans EBS to something like a dedicated server. Most apps need permanently available storage.

Of course, if you don't need permanent storage (and your needs are bursty) than using EC2 is probably a huge win.

Re:Everpix was great. This is how it died by sameer_sundresh on Tuesday November 05, 2013 @06:57PM (#6679467)
Your second paragraph exactly describes Everpix's computational needs: bursty with no use for local persistent storage.
Re:Everpix was great. This is how it died by rpedela on Tuesday November 05, 2013 @04:18PM (#6678389)
Dedicated servers don't really give you permanent storage either. Granted, it is more permanent than EC2 instance storage, but hard drives do get corrupted. You still need backup and replication for a robust solution.
Re:Everpix was great. This is how it died by rhizome on Tuesday November 05, 2013 @05:18PM (#6678833)
"Disk is cheap"
Re:Everpix was great. This is how it died by aespinoza on Monday November 11, 2013 @04:16PM (#6714099)
Thank you for your answer. I agree with you. And after I read this article I went on to do some research decided to move the servers in-house. But I am also researching a Hybrid cloud using AWS.
Re:Everpix was great. This is how it died by x0x0 on Tuesday November 05, 2013 @02:40PM (#6677602)
s3 seems great for scaling out storage, but I'm sure there are gotchas.

I work in a very different area, but my experience with ec2 are you should drop what you're doing and immediately price out leaving. Roughly: for big hadoop tasks, ec2 is a horrid environment. The boxes are slow, flaky, and shitty; the network is slow and super shitty; and everything about the experience is ass. Oh, and the emr admins are assholes who push broken code; code that couldn't even have run once. These assholes, after issuing us a hotfix to a boot action, proceeded to change the path to the hotfix (without mentioning it to us), breaking our production clusters twice in in 30 hours. I guess I hold a grudge but I like sleeping. The point is emr and perhaps ec2 are complete amateur hour.

Quoting myself earlier:

   from a former employer who wants to stay anonymous, ec2 bill per month: $97k 
   peak, softlayer: $26k. 1/3 the cost, 2x the performance.
   
   And let's not mention emr; a $15k/mo cluster in softlayer did something like 
   5x the performance of an emr cluster that was costing (and running!) $2k/day.
I'm not kidding about 1/3 the cost and twice the performance. And this wasn't even with rack/switch local boxes, which would improve performance even more.
Re:Everpix was great. This is how it died by zaidf on Tuesday November 05, 2013 @04:11PM (#6678347)
I can vouch for your numbers. My music start-up was one of Softlayer's early customers. We stayed with them for a while before moving to an even cheaper host. In all, we were pushing over 100TB and paying under $3,000/mo for everything(web, storage, db servers).

This was over 5 years ago. I am sure things would be even cheaper now.

Re:Everpix was great. This is how it died by diziet on Tuesday November 05, 2013 @05:16PM (#6678819)
Soft Layer seems to be as expensive as EC2, if not more expensive, especially when compared to reserved instances.

The 244gb cr1.8xlarge (16 cpus, 240gb ssd) amortized over 3 years costs $659 / month. Softlayer would charge quite a bit more for similar specs ( order of magnitude more).

Re:Everpix was great. This is how it died by keithwarren on Tuesday November 05, 2013 @02:42PM (#6677616)
My startup is in the same space as them and I can promise you that running our own storage is much cheaper. Azure and AWS run around 7K per month for 100tb.

When you factor redundacy I need to buy 200tb, factor in other server infrastructure with the cost of a 4TB drive running around 180 and I can spend 15K to buy 200TB of storage.

Put another way, we can own twice the storage capacity (or 1x mirrored) for roughly 2 months of S3 storage.

Re:Everpix was great. This is how it died by parasubvert on Tuesday November 05, 2013 @07:57PM (#6679772)
S3 is already redundant - it virtually guarantees no data loss and mirrors your storage across multiple data centres.

You're also completely ignoring the costs of hosting this stuff, the computers they're in, redundant network switches, failed disks over time, and administration costs to rack and stack failed drives plus all the risk associated with your redundancy going wrong. You're also assuming your hard drives will be able to handle the performance needs. Not to mention this is one site - no DR.

So, Amazon S3 at $7.5k a month for 100 TB is $90k annually with RIDICULOUSLY high redundancy and known performance. Reduce it to 99.99% availability (about what your setup with dual drives might be if you run it well) and you're at $60k annually.

You really are going to host fast, reliable 100 TB for under $60k? Betting your business on it?

Re:Everpix was great. This is how it died by swisspol on Tuesday November 05, 2013 @03:23PM (#6677954)
It's something that was absolutely on the table for our planned 4th generation infrastructure. It was unlikely to us we could stay on AWS. We already had 400 millions full-res photos and running 80+ EC2 / RDS instances for 50,000 users. At our growth rate, we would have been close to a billion photos by end of year.

It's far from simple though: you need to find the people who can build such systems and also be able to afford the capex. And then there's the risks of running your own system and opportunity cost.

It's really unclear we would have been able to go this far in the first place without AWS.

Re:Everpix was great. This is how it died by rhizome on Tuesday November 05, 2013 @03:42PM (#6678121)
Not to pile on, but a storage startup should have had a systems person among the 7 employees. I would do it in the first 10, but the only reason it wouldn't be in the first 5 is that I have the skills myself.

It's really unclear we would have been able to go this far in the first place without AWS.

You could have drastically cut your burn on that last $550K by hiring a sysadmin and bringing it all out of AWS (maybe keeping S3). This would have likely also involved retooling on the app side, but in the long run it would have given you more time for positioning/promotion/etc. All in all, 4th Gen is way late for this.

P.S. Number of photos is basically irrelevant, were you actually using market-fit metrics for infrastructural decision support?

Re:Everpix was great. This is how it died by keithwarren on Tuesday November 05, 2013 @03:39PM (#6678095)
Any idea what the average storage take per user was?
Re:Everpix was great. This is how it died by beachstartup on Tuesday November 05, 2013 @05:02PM (#6678730)
yes. they would have 100% been better off, provided they actually knew what they were doing, which i guess is questionable since the business failed.

pricing out servers and researching / working with smaller infrastructure providers who actually care about you and your account (imagine that) is real work, which is why so many people avoid it these days.

it's much easier to click a few buttons and "choose" machine type x in the offerings that amazon has designed to maximize their own profit.

computers are hard, let's go shopping.

Re:Everpix was great. This is how it died by ye on Tuesday November 05, 2013 @05:47PM (#6679030)
Your alternatives are

1) Switch to other cloud providers, I'm not aware of any very cheap ones.

2) Switch to other hostings, which can be 1/10 as cheap as AWS, but then you have to deal with the failures.

3) Colocate and build your own servers/storage. It's only cheaper if your bill is much more than a 24/7 sysadmin(s) salary.

I suspect DropBox don't give a shit about server costs, they are swimming in money. But I bet having their own data centers will save them money.

Re:Everpix was great. This is how it died by asdasf on Tuesday November 05, 2013 @03:26PM (#6677976)
Yes, when you have a large amount of storage, it is well worth doing it yourself. The cost of redundant storage devices with replication ends up being paid for in like 3 months of S3 bills.
Re:Everpix was great. This is how it died by hbbio on Tuesday November 05, 2013 @04:16PM (#6678378)
I could not agree more. Running on Amazon instead of let's say OVH incurred maybe 10x costs. At the same time they probably didn't have an adequate pricing and freemium ratio and/or didn't do enough to market their good product. I could have been a customer but was not aware of everpix.