Ask HN: How to validate people's willingness to buy without breaking promises?
In a nutshell, the author was seeking to answer two questions. The first was trying to assess whether there was a potential market for the author's idea. The second question was seeking an answer was: "Will people pay enough to make this a meaningful business?" It is how the author goes about answering the second question that concerns me here.
The author put up a basic web page with a simple web site with a button to order the product in question. The button actually sent the potential customer into a purchase work-flow which ends up charging their credit card. The author follows-up with an email indicating that the product is not available and offers a full refund. Some "customers" request this, but the majority do not. Eventually, the author ends up refunding all of the "customers" since the author is not able to deliver on the promise of fulfilling the order in the time frame specified in the follow-up email. I do not think the author was intentionally misleading the "customers" on this point. I think the author did not realize how much work would be involved in actually fulfilling that promise. It comes out later in the article that an unspecified amount of money is spent over a time frame approaching a year before they were able to deliver on the initial promise. (I do not know whether the business was able to deliver on the promise to the original "customers".)
Is there a way to do an experiment on the cheap, that does reliably validate the business without misleading potential customers in the process?
[1] I debated about whether I should link to the article. I have decided not to. Really, this article could have been written (and has been written) by any number of folks about any number of businesses.
A half decent example is Evernote (recent financial troubles aside). Imagine trying to cook up a super quick landing page for Evernote and then buying some adwords. I'm pretty sure you wouldn't get very far because who wants "Notetaking App #784" (which is about all the information you can give in such circumstances)?
Based on that you'd assume no one wants to pay for/download a note-taking app. Of course this is provably false as many people pay for myriad note-taking apps. Where's the discrepancy?
When you land on a products landing page there's far more than just product screenshots. There's also the impression created by the brand, one you've probably heard of before you got there. There's customer reviews, there's well thought out pricing designed to make you pay exactly what you can afford, there's a thousand techniques used to make sure they get the sale.
Effectively, I'd say it's very difficult to distill all this down into a quick experiment that proves anything.
In asking my question and relating the background, I am not seeking for folks to change my opinion of the ethics or to disparage anyone who disagrees with me. I am seeking to understand whether there is a way to experiment in a way that does not make promises that may or may not be kept. (Promises are broken, for example, when only a handful of people "purchase" the product, and the "business owner", therefore, chooses not to pursue the business, even if refunds are provided.)