News for hackers. Stuff that matters.
Re:Combatting illegal abuses of ngrok by patio11 on Friday May 30, 2014 @03:16PM (#7823460)
I think this is an excellent illustration of a situation where your users get a better experience by being asked to pay money than they get by being given services for free. Putting any pay gate in front of this will greatly decrease the amount of abuse you get. You'll still have abuse problems, but abuse is largely a matter of "outrunning your friend, not outrunning the grizzly." When you're free and automatable, you are the weakest link on the Internet for possible exploitation. Even though people can use e.g. stolen credit cards and fake data to sign up for services, you will no longer be the weakest link even with that trivial barrier, greatly decreasing the amount of abuse you'll suffer.

This is why Appointment Reminder requires a CC upfront, by the way. I have very little desire to again be on a conference call with a lawyer and a police detective about violation of a restraining order made possible by an ex-husband being able to essentially proxy his harassing phone calls through my software.

There exist a variety of potential scalable anti-abuse measures you could implement here. For example, I think that foo.ngrok.com should probably have a low, hard limit on how many IPs/regions/etc should be able to connect with to it. Nobody should be putting production systems on it, so if 100 IPs are connecting to one of the ngrok sites, that's likely either a) abuse or b) a use case which you should not be supporting on a free tier.

Relatedly: the problem with abuse, here and elsewhere, isn't limited to "My hosting provider is opening tickets. If I don't catch one, the site shuts down." Abuse which your hosting provider doesn't catch is still abuse. You didn't get into the business to make the Internet a darker, more dangerous place. Make the necessary technical/business changes to avoid operating a public nuisance.

Re:Combatting illegal abuses of ngrok by inconshreveable on Friday May 30, 2014 @06:31PM (#7824460)
I disagree with respect to a pay gate. A payment gate on ngrok, even something as simple as requiring a credit card number would pose a significant barrier for a large swath of ngrok users. As some motivating evidence I can tell you:

I've had requests to support niche payment systems (whose names I can't even recall) because the country's credit card infrastructure is poor or not commonly used.

I've had a number of people tell me that their credit card wouldn't process because their provider is not supported world-wide.

ngrok is useful to students, some in high-school or even younger who surely don't have easy access to a credit card.

Sure, I could make those people email me with special requests to get around the system, but that greatly degrades the experience and moves initial experience from joy -> frustrating.

There are a number of possible technical solutions I would rather pursue first before greatly damaging first-time user experience and funnel.

Re:Combatting illegal abuses of ngrok by patio11 on Saturday May 31, 2014 @12:41AM (#7825294)
I won't disagree that putting a credit card form up is a barrier, principally because constructing barriers is the point of the exercise. Net-net, it strikes me as better to inconvenience a fraction of users predictably with mitigation in place versus inconveniencing all users unpredictably in a difficult-to-recover-from fashion when e.g. your hosting company sends you a termination letter.

By the way, since you mention you haven't worked in hosting before: you should know that you're at risk of getting your account terminated, even if you answer all tickets in a timely fashion. Every ticket opened against you represents multiple fairly highly-paid humans having to interrupt their work days. They accept this as a cost of doing business the first few times. You will eventually be told "You don't pay us nearly enough to generate this volume of tickets. Take your business elsewhere."

Anyhow, your business, ultimately your call. If you're looking to do primarily automated solutions:

1) Risk score customers. You can do this in intelligent, data-driven fashions, but you'll get results quicker by just coding heuristics. Some heuristics which you'll find valuable are "Where is the ngrok client getting called from? Does it come from a number of high-risk countries?" (I know, I know, most people hate the implications here but it is a case of being mugged by reality), "What OS are they using for the client application?", "Has the machine invoking the current ngrok subdomain been banned before?", "Does the subdomain receive traffic from 'far away' from the IP we're sending it to?", "Does the subdomain receive traffic from more than N IPs?", "Is there a large lag between creation of the subdomain and first use?", "Does an IP create multiple subdomains either in parallel or in series?", etc. You can easily make people's access increasingly open as their risk score approaches Presumed Safe and make it more restricted as their risk score approaches Quite Possibly Not Safe. (This is a nice compromise which lets legitimate users without a credit card in without-loss-of-generality China continue to get non-zero value out of ngrok.)

2) You may wish to have your client application fingerprint systems which it is installed on. (There exists substantial literature on this.) Add abusers' fingerprints to a hellban list: their IPs can see their sites, and maybe the first 3 IPs accessing their subdomain see it and get added to a bucket which shares their hellban, but everyone else mysteriously 500s out. This will make it hard for abusers to realize "Doh, I have been found out and need to switch proxies or rooted boxes."

P.S. Customer to vendor here: irrespective of your decision with regards to people who don't pay money for your services, please charge more. It will give you more resources to fix this problem so that you don't get shut down again and ruin my Twilio programming productivity.

Re:Combatting illegal abuses of ngrok by neil_s on Saturday May 31, 2014 @09:15AM (#7825923)
I agree with @patio11, this seems like an amazing service that I can't wait to use now that I have discovered it, but similar to those running open proxies on the net and thus creating negative externalities for the rest of the web, you have a certain responsibility to block abuse before it is reported to the hosting provider.

Maybe something like Sift Science could help automatically create these heuristics. You could just modify your script to notify their systems every time abuse is reported, and it could learn the features of potential abusers.

Re:Combatting illegal abuses of ngrok by lawl on Saturday May 31, 2014 @11:43AM (#7826280)
> you should know that you're at risk of getting your account terminated, even if you answer all tickets in a timely fashion. Every ticket opened against you represents multiple fairly highly-paid humans having to interrupt their work days.

The solution is to SWIP the IPs to ngrok. Then the provider is out of the loop. If it's a decent hoster I hope that's what he reccomends instead of just kicking ngrok.

Re:Combatting illegal abuses of ngrok by biot on Friday May 30, 2014 @07:43PM (#7824665)
If you want to have ngrok as a free public service, then abuse will be hard to get around while keeping it fully featured. However, to preserve the initial user experience you could allow the first 5 IP addresses to access the tunnel of unvalidated accounts. This should let them experience the full benefits themselves and/or with their friends or a few remote services and can keep using it with only those first 5 IP addresses. Afterwards, they can jump through extra hoops to remove restrictions. For example:

  * Free plan: keep using it with up to 5 IP addresses. Rate
    limited to 512 Kbps total.
  * Lite plan: register by having us send you an SMS. Unlocks up
    to 10 different subnets (allows the entire /24 or /16 etc.
    network block based on whois lookup).
  * Home plan: pay us $X and remove all IP restrictions. Up to 5
    simultaneous connections at 512 Kbps per connection.
  * Professional plan: pay us $Y and remove all IP restrictions.
    Up to 15 simultaneous open connections at 1.5 Mbps each.
  * Enterprise plan: need something custom? We're happy to put
    together a quote.
This limits your exposure to abuse to the first 5 visitors without degrading the experience. Once that threshold is hit, you can response with a "429 Too Many Requests" type of server response, with a link to more info. You could also let users expire IP addresses/subnets, freeing up new connections from new IPs (with appropriate rate limiting). Successive levels of hoops, both free and financial, unlock additional benefits for those who want to pay for them.
Re:Combatting illegal abuses of ngrok by josephlord on Friday May 30, 2014 @07:14PM (#7824596)
Can you run your paying customers on a different system (preferably different host provider) to the free ones to prevent a ban triggered by the free users affecting the paying customers?
Re:Combatting illegal abuses of ngrok by yannis on Saturday May 31, 2014 @07:41AM (#7825821)
A payment gate on ngrok would defeat the very essence of what the word "ngrok" came to mean. You Sir, have the greatest respect from me, and would agree that a technical solution is possible and conceivably orders of magnitude easier than the development of ngrok. On my things to do before I depart this world, is to understand how such a marvelous piece of software can be developed.
Re:Combatting illegal abuses of ngrok by 0xbadcafebee on Friday May 30, 2014 @04:12PM (#7823746)
Your last paragraph isn't just related, it's the main issue. Before he concerns himself with how to prevent his business from being shut down he should consider if his business is doing more harm than good.

By Monday there's going to be 10 job openings in the valley for a Technoethicist.

Re:Combatting illegal abuses of ngrok by 8ig8 on Friday May 30, 2014 @08:51PM (#7824837)
> I think this is an excellent illustration of a situation where your users get a better experience by being asked to pay money than they get by being given services for free.

I don't follow. As a prospective user, trying ngrok for the first time, how is my experience better if I'm required to pay to try it out versus jumping right in and creating my tunnel without creating an account or taking my credit card out of my wallet?

Re:Combatting illegal abuses of ngrok by patio11 on Saturday May 31, 2014 @12:11AM (#7825230)
Your first run experience with ngrok is acutely sensitive to whether ngrok has been disabled by the hosting provider in the last 3 hours.
Re:Combatting illegal abuses of ngrok by natch on Saturday May 31, 2014 @12:14PM (#7826365)
But didn't the article just explain how he put in place steps to make this extremely unlikely?
Re:Combatting illegal abuses of ngrok by patio11 on Saturday May 31, 2014 @03:05PM (#7826922)
I read the description of the system. I disagree that the current implementation secures the future of ngrok.
Re:Combatting illegal abuses of ngrok by cookiecaper on Friday May 30, 2014 @10:24PM (#7825041)
Your experience isn't better, except in the degree that the user base benefits from the increased morale, motivation, and time and monetary resources of the business owner. I think this is too intangible to really quantify. I suppose you also benefit from the health of the service's reputation -- if ngrok becomes known primarily for hosting illegal content, it'll most likely be blocked in a way that seriously harms the service you host through it.

Patrick is definitely right that it's nice to be able to avoid widespread abuse as a business owner so that you don't have to deal with the cops, etc., but that doesn't have a direct effect on the users.

Re:Combatting illegal abuses of ngrok by 8ig8 on Friday May 30, 2014 @10:52PM (#7825081)
Me, being a dick (trying to make a point)... Does your mom give a shit about the so called user base?

I'm a customer. I don't give a shit about the 'user base'. I don't even know what that means. I need run a test on some mobile layouts from my desktop. All this other BS means nothing to me right now.

Why is this different from selling detergent in Target?

Re:Combatting illegal abuses of ngrok by inportb on Saturday May 31, 2014 @12:28AM (#7825273)
You're a customer. You don't give a shit about the 'user base'. You don't even know what that means. You need to wash some clothes at home. All this other BS means nothing to you right now.

So you head over to Mallwart for some free detergent. Because you could jump right in without creating an account or taking your credit card out of your wallet, you have a vastly improved shopping experience compared to, say, buying detergent at Target.

That's the difference. Putting up a paywall limits abuse at the expense of shopping experience.