News for hackers. Stuff that matters.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by pg on Tuesday March 20, 2012 @02:17PM (#3730691)
Believe it or not I like this being the top story. We know there are lots of bugs in our process and we want to hear the bug reports.

I went back to look at the application. It fell immediately below the threshold for invitation to interviews. I.e. if even one of us had given them a grade one step better, they would have made it to interviews.

When we make mistakes, it's usually in this phase. Most of the time when we screw up it's by not inviting a group to interviews, rather than by interviewing them and turning them down. So this startup is exactly where a mistake would be most likely to occur: in the applications that fell just short of the cutoff for interviews.

The good news is, we'd already decided to fix this problem. We're going to do 3 interview tracks for s2012, which will let us interview 270 groups instead of the 180 we did last time.

If we'd done that last time, we would have interviewed these guys. But last batch was the first time we did parallel interview tracks at all, and we needed to test whether it worked for 2 before we went to 3.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by bambax on Tuesday March 20, 2012 @03:32PM (#3731078)
I don't know if I'm going to be able to express what I feel but I'll try.

YC "bugs" are

- startups that are accepted and fail

- startups that are rejected and fail, but would have thrived had they been accepted

(Of course this last kind of bug is extremely difficult to track down.)

But if a startup makes a killing after being rejected by YC it means they didn't need you.

If you consider this a bug, there's some kind of moral problem because it means YC is trying to siphon every promising team in order to maximize YC's success, independently of who YC is likely to help more.

You're not just betting on horses, you're also training them: it seems what you should want to maximize is YC's impact...?

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by wheels on Tuesday March 20, 2012 @08:05PM (#3732370)
You're confusing YC with a charity. It is not. Trying to invest in teams that will succeed is the modus operandi of virtually all venture investors, YC included.

YC is trying to rewrite a lot of the rules of venture investing, and has had quite some success there, but at its very core it's important to remember that they are investors. At the end of the day, the measuring stick of an investor is their returns, not how many (proto-) companies they pulled from the brink of implosion. As such, your second measuring stick rings false.

I suspect that AirBnb, Dropbox and Heroku are simultaneously among the investments that YC is the most proud of and the companies that would have been most likely to succeed had they not been a part of YC.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by noahc on Tuesday March 20, 2012 @05:07PM (#3731579)
>- startups that are rejected and fail, but would have thrived had they been accepted

PG has specifically stated that this is not a bug (it's a feature). The goal of YC is not to take mediocre or bad startup teams and turn them into wins, but to take the winners and turn them into Super-Winners(Dropbox).

As far as maximizing YC's impact, I think Dropbox maximizes it more than small wins from teams that would have lost had they not been in YC.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by jwb119 on Tuesday March 20, 2012 @03:39PM (#3731115)
You're considering success or failure as a binary outcome. It's possible that a startup is accepted and wouldn't have failed anyways, but that being in YC makes it a bigger success than it otherwise would have been (through mentoring or other intervention by YC). My understanding is that is the sweetspot for YC anyways - everyone is a winner there.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by bambax on Tuesday March 20, 2012 @05:49PM (#3731843)
> You're considering success or failure as a binary outcome

I think that's how it is, yes, and PG seems to have stated as much; in essence, you either die or don't die; if you don't die, the scale of your success depends on a lot of things that are beyond your control.

(Actual quote from PG: "The formula for the success of a startup includes a random multiplier of roughly zero to a thousand." — http://news.ycombinator.com/item?id=3050280 )

If one subscribes to this point of view then the purpose of YC is to help startups not die, and the purpose of the YC admission process is to

1. select all startups that have a chance of not dying if admitted (eg, refuse startups that don't stand a chance in hell of not dying)

2. if the sample from #1 is too large, reduce it at the low end first (startups that are not very likely to not die) but maybe also at the high end (startups that seem certain to not die no matter what)

Maybe reducing the selection from the high end is just plain stupid / counter productive, but if you don't do that, it's not very clear why one would be in this business in the first place (as opposed to other lucrative businesses).

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by vibrunazo on Tuesday March 20, 2012 @07:00PM (#3732133)
I think you're both right. Success can be understood as binary, depending on how you interpret it. You either fail or you don't. But YC can help you find that faster than without YC. So there's room for improvement even if success is binary.

These guys got 10k users in a month. But maybe they'd get 100k in 3 if they had YC. Even if you understand that either way it would be a success anyway. It's still reasonable to assume that it would be a worthwhile deal for them. If YC missed the opportunity to help them get even better, even faster. It's reasonable for both sides to treat that as a bug.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by mirsadm on Tuesday March 20, 2012 @03:46PM (#3731149)
I think a more important aspect is that YC is able to connect with exceptional individuals (and groups). Even if one particular group fails they may add talented individuals to their network and connect them with other more successful startups.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by pemulis on Tuesday March 20, 2012 @04:20PM (#3731317)
I don't really see the moral problem. YC is a group of investors, not a charity. Of course they're going to look for the kind of hardy founders who would succeed even if they got rejected.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by bambax on Tuesday March 20, 2012 @04:41PM (#3731437)
Yes, they're not a charity. They're also not a pension fund. To me they look a little like a prep school (but maybe I'm wrong).

The mission of a prep school is to help good students become brilliant; if it becomes stuffed by already brilliant candidates (for example because the admission process is more selective than the admission process of the college it preps for), so much so that there's no place left for second-tier students who would make the most of its teaching, then there's a problem.

I'm just wondering if this is something YC worries about or should worry about.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by pemulis on Tuesday March 20, 2012 @05:21PM (#3731684)
I see what you mean, since Y Combinator is an institution now, and its selection process has an impact on the overall ecosystem. But let's say Startup A, which is top-tier, would become a $75M company with Y Combinator's help, but would become a $50M company without them. Meanwhile, Startup B, which is second-tier, would become a $3M company with Y Combinator, but would become a $30K company without them. Even if we throw profit out the window (which an investment group doesn't do, obviously), Y Combinator would add a greater total dollar value to Startup A than to Startup B, even though they would multiply the value of Startup B by 100x.

Also, elite prep schools do try to fill their classes with nothing but brilliant students, for a variety of reasons, including money and prestige. There are some negative consequences, to be sure, but it happens. At least Y Combinator increases the size of its classes every year, unlike prep schools.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by tptacek on Tuesday March 20, 2012 @06:33PM (#3732040)
YC is not like a prep school. It is a win condition for the YC model (really, for any investment system) if so many top-tier companies apply that there's no room for second-tier companies. YC is a business, not a public good.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by bambax on Wednesday March 21, 2012 @08:01AM (#3733944)
Many comments to my initial post point out that YC is not a charity. We can all agree on that.

Prep schools are businesses too, BTW. And yes, businesses have a responsibility to their shareholders to maximize profits. But if that was the only purpose of any business, everyone would be selling luxury watches.

YC is not a pension fund putting money in a VC; YC "makes it happen". They invest in very early stage companies because they believe that they can help them succeed (and they do).

In 2004-2005, PG famously predicted the second coming of Apple; if he had put all of his money in Apple stock then, he would be 17 times richer today. And yet that's not what he did. At the same time he was making this prediction, he founded YC.

- - -

I can't seem to explain myself clearly, but I'll give it another try.

The total return of an investment fund is really the return on a very few top investments, which tend to dwarf all others.

Now, if you had a magic prediction device that let you identify for certain the next Google, it wouldn't make sense from a profit-maximizing point of view to invest money in any other company: just put all your money in the next Google and you're done.

It's safe to assume that YC, who have been in business for 7 years (really 14 since they have 2 rounds per year) are getting better at what they do. They should be able to predict who's likely to succeed and who's not, better and better each year.

Therefore in all logic they should be reducing the number of startups they fund: put more money in sure winners and don't fund anybody else.

And yet they're doing the exact opposite: each batch is larger than the previous one.

There can be only two explanations to this: either they're getting worse and worse, and are spreading their bets; or, they're getting better and better and can afford to offer their services to more and more companies.

It seems likely that the second option is the correct one.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by blacksmythe on Wednesday March 21, 2012 @01:49PM (#3735516)

  >> put more money in sure winners and don't fund anybody else
That is not their business model. Their model is to take a small fraction of the company for a small amount of money, and then help them succeed.

  >> There can be only two explanations to this: either they're getting worse and worse, and are spreading their bets; or, they're getting better and better and can afford to offer their services to more and more companies.
So far YC has a fantastic return on investment. I imagine that their returns are the envy of many conventional VC firms.

They invest so little per company that they can afford to invest in every company where the expected return on investment exceeds the amount invested.

As they become better known, they get more and more qualified applicants, and thus the number of bets that they make should be expected to increase over time.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by sskates on Wednesday March 21, 2012 @02:14AM (#3733337)
Why shouldn't Harvard take all the best students?
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by goatcurious on Tuesday March 20, 2012 @06:13PM (#3731954)
I think PG is talking about YC's selection process. A startup applied, was not accepted, but became a success. Selection is the core of YC team's job, and this post is a self reflection on how can they get better. In that sense, this is certainly a bug.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by InclinedPlane on Tuesday March 20, 2012 @04:29PM (#3731351)
From YC's perspective there are two ways in which they win when they invest in a company. On the one hand they make a return on their investment, classic straight-up utility maximizing economics. On the other hand they help a startup succeed, which is part of their overall purpose aside from raking in fat stacks of filthy lucre.

Even if a company succeeds without YC that doesn't mean that YC's potential involvement is a no-op. On the one hand that represents a missed opportunity for revenue. It also means a missed opportunity to perhaps accelerate the growth of that company beyond what it has managed to achieve on its own.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by ma2rten on Tuesday March 20, 2012 @05:26PM (#3731702)
If a company can only succeed by getting funding though YC, they should not fund it, in my opinion. I don't think those founders are ready yet to start a startup.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by padobson on Tuesday March 20, 2012 @04:50PM (#3731489)
I think this is too narrow a range to determine where bugs are in the process.

Bugs in the application process can only really be rooted out by startups that apply and are successful.

Startups that apply and fail could point to a bug in a number of different areas - not just the application process.

If the purpose of YC is to make money and improve startups, than they are failing at both of those things if they pass on startups that eventually succeed.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by pbreit on Tuesday March 20, 2012 @09:51PM (#3732693)
I don't think that makes any sense at all. Like any organization or group, it is seeking the best. In fact, I would imagine they'd be delighted bringing in folks even YC could learn from. I'm sure PG would be the first to say he doesn't have all the answers and cannot magically make every team be successful. Suggesting it's a deficiency in morality is absurd.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by yesimahuman on Tuesday March 20, 2012 @02:49PM (#3730857)
Thanks Paul, we have no hard feelings and are really excited to hear we were that close. We just want to encourage other startups not to give up.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by rexreed on Tuesday March 20, 2012 @05:59PM (#3731881)
If offered a spot now in YC, would you take it? Not going back in time, but actually, now? If so, and if PG has already admitted it was a mistake, what's to stop YC from offering you a spot in their next session and you taking it? Are there no "re-dos" in YC? Just asking.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by kamaal on Tuesday March 20, 2012 @11:45PM (#3732998)
I think that decision boils down to what value YC can bring to their company now.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by webwright on Wednesday March 21, 2012 @01:05AM (#3733217)
Many of the companies who apply to YC have this much traction... There's certainly a TON of benefit to be had from YC at their current stage.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by rexreed on Wednesday March 21, 2012 @03:01PM (#3735942)
That's my question -- would YC make the offer now, and would the company accept it? Basically, could there possibly be a re-do? The answer might be "no" for both, but it might be "yes". Is applying to YC and accepting a one-shot deal for all parties, or can there ever be a chance to get back together? From the responses and posts, it looks like it's a one-shot deal - either they accept you and you accept the offer, or there's no chance to get together again in the future.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by AdamFernandez on Tuesday March 20, 2012 @02:53PM (#3730876)
I don't think much explanation is necessary. YC is never going to catch every potentially successful startup. The process can be refined, but you will never recognize all of them. Averages being what they are, I think YC has done very well. The Codiqa team showed tenacity, and when YC didn't work out for them, they found another route. They are a great example for other startups. None of this should put YC in a negative light.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by pg on Tuesday March 20, 2012 @03:23PM (#3731028)
Never say never. We may always miss a few, but I think we can get better at judging applications.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by j45 on Tuesday March 20, 2012 @02:26PM (#3730739)
I can't imagine what it's like to go through so many applicants, so I won't.

A few thoughts:

- It would be interesting to see what made them 181 instead of 179. Would applicants this close to the cutoff get feedback of any kind about how they fared?

- Whoever ranks 271 might be missed out too in the future.

- Has any thought been given to sharing "you're this close" details with the 50 or 100 applicants that were within the proverbial whisker, or giving them a second review to see if any would move up or down relative to their peers in the same range?

0.02

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by pg on Tuesday March 20, 2012 @02:48PM (#3730850)
The closer a startup gets to the cutoff, the less there is to say about why they fell below it. I talk about that phenomenon here:

http://ycombinator.com/whynot.html

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by zawaideh on Wednesday March 21, 2012 @09:03AM (#3734139)
I LOVE that you are calling them bugs and taking the selection process very seriously. We (Sandglaz) had a similar experience where we went from 4000 to 35000 users after YC rejection.

That said, interviews and applications are inherently subjective and based on a snapshot in time; they will always have "bugs". It is a tough thing to do, and I fully appreciate the effort going into it.

Best of Luck!

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by joedev on Tuesday March 20, 2012 @03:42PM (#3731129)
This post seems like a success story, so far. So how is not interviewing them a bug? If you are seeking startups who need help identifying how to get customers and how to create products people want, then it seems that Codiqa doesn't fit. Codiqa has customers and is making products people want.

Said another way, the delta between where Codiqa stands today vs. where they would be had they been interviewed does not seem as large an opportunity as probably the opportunities you made for the companies you did select. Therefore, I'd say there's no bug.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by bicknergseng on Tuesday March 20, 2012 @02:25PM (#3730734)
Look at it this way: at least you interview everyone you accept. Most colleges interview only a few prospective students, and that's for a four year program rather than a three month one.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by bicknergseng on Tuesday March 20, 2012 @03:45PM (#3731143)
I meant this as a compliment for the hard work you guys do evaluating all the potentials and making deliberate, thoroughly evaluated decisions on who you work with. I'm sorry if I didn't convey that properly.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by cinquemb on Tuesday March 20, 2012 @06:25PM (#3732007)
Here's a possible solution for the future, have YC former accepties conduct proxy interviews for applicants where ever they are in the country(world) on their convenience. It could help you out, unless you feel that the people you accept are unable to help you make your decision. Ivy league schools do it with alumni, YC could do it with alumni.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by tibbon on Tuesday March 20, 2012 @11:42PM (#3732993)
From what I understand, some of that currently does happen- just not on a huge scale. Alexis is in NYC repping YC there for example.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by mirsadm on Tuesday March 20, 2012 @02:26PM (#3730738)
Are you guys keeping track of statistics of grades for applications? I am wondering if at some point there is a clear cut off that you can safely say we don't need to interview these groups. If it is a linear/gradual decrease I'd imagine it would be very difficult to find that threshold.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by pg on Tuesday March 20, 2012 @02:50PM (#3730861)
The probability that we will fund a startup decreases pretty smoothly as you go down the list. It's not asymptotic at the cutoff. We'd probably have to interview half the applicants to get that last one. Which would kill us.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by pork on Tuesday March 20, 2012 @04:21PM (#3731321)
Interesting...you guys sound more and more like a hedge fund (and I say that in a positive light).
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by kamaal on Tuesday March 20, 2012 @11:59PM (#3733042)
I don't know what to reply except that the very words 'process', 'interview', 'batch', 'moderation' these all exist to bring sanity and order into any system at the expense of mediocrity.

Like someone said "Micheal Jordan would NOT want to be selected by YC".

This means people like Mark Zuckerberg, Larry Page, Sergey brin, Bill Gates, Steve Jobs are not likely to come out of YC. Because the very fact that they have to go through layers of interview sessions, and then spend time performing to you, to get your attention like some performance artist performing to the king to get his attention means that is not going to happen.

Because people screw up in interviews. And a interview is generally no measure what the true story actually is. The guide to cracking interviews and performance is learning how to game the system. If your process is known to people outside,and they plan enough to cover all the corners and deal their cards well, they can game your interview process. That's how job hoppers who can do nothing hop around in circles of big successful companies. The situation from evaluating a 'good product' changes to evaluating 'how good the interview went'.

Nerds, Geeks of the best quality hate all this interviewing, playing-to-the-galleries-business. That is why they wish to build their own firm. Now if you subject them though the same bureaucratic process which they had otherwise go through in a traditional large corporate(Applying, interviewing etc) they are just going to go away, take money from somebody else and build some stuff in the same time.

If I would be building a business and need funding from somebody. I would go to them and explain them 'whats in it for them' and take their money.

But if have to go through the same large corporate styles process for this, I will be spending my time for something else. Because the very purpose my starting a business is to avoid that corporate styles processes.

You have to seriously ask what value you bring, or how different you are from anybody else. If you are just evaluating profit prospects(which I agree, is important), funding, taking profits back. Then really you are just another VC. There is nothing wrong with that. But that is what it boils down to.

Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by tapertaper on Tuesday March 20, 2012 @04:09PM (#3731262)
Michael Jordan would WANT to have been rejected.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by coryl on Wednesday March 21, 2012 @12:17AM (#3733083)
What? Nobody wants to be rejected, ever. Everyone wants to win, always.
Re:From YC Rejection to 10,000 Users in 1 Month (with stats) by amalakhov on Wednesday March 21, 2012 @01:03AM (#3733213)
Are there any differences between the tracks and interviewing teams (beyond purely idiosyncratic individual preferences/quirks)?