Re:Show HN: A simple IP address API
by jgrahamc on Friday February 14, 2014 @12:28PM
(#7239679)
I use https://freegeoip.net/ which gives you output in JSON, CSV or XML and has a limit of 10,000 requests per hour. The limit of 1,000 per day on this service is too low.
Re:Show HN: A simple IP address API
by samuelkadolph on Saturday February 15, 2014 @12:02PM
(#7244334)
If you are geolocating, I would suggest spending $370 to buy the MaxMind GeoIPCity database. There's an nginx module for it and any major language will have code to run queries against it.
Re:Show HN: A simple IP address API
by shortstuffsushi on Friday February 14, 2014 @12:49PM
(#7239839)
So something along the lines of tracking incoming requests, then doing a DNS lookup on the incoming IP? Isn't that something that something like Google Analytics could do for you? And in that case, would this be more for people who are avoiding GA?
Re:Show HN: A simple IP address API
by dudus on Friday February 14, 2014 @03:12PM
(#7240720)
Google Analytics can give you this data in the reports but won't allow you to get access to it in real time in your application.
Imagine you want to redirect users to the correct country page in your site. In this case you need to get access to the ip geolocation in real time. GA won't help you there.
Re:Show HN: A simple IP address API
by watson on Friday February 14, 2014 @03:34PM
(#7240823)
If your goal is geo-redirection then a 3rd party service is usually a bad choice (speed + downtime). An memory geo-ip database is the best way to go - but this is usually also part of what you pay for when you buy the non-free version
It's less accurate than their commercial offering, but good enough in many cases. For ease of use, there's a nice C API (https://github.com/maxmind/geoip-api-c) and wrappers like pygeoip for Python.
Re:Show HN: A simple IP address API
by arthulia on Saturday February 15, 2014 @01:08AM
(#7242882)
But freegeoip's limit of 10,000 requests per hour is better than ipinfo's $200/mo plan (6,667/hr). Plus there are no limits if you run freegeoip on your own server.
Re:Show HN: A simple IP address API
by daviding on Saturday February 15, 2014 @02:39AM
(#7243035)
Looks like no immediate fix either, which is a shame as I wanted to use it client side but (a) need SSL and (b) can't ignore Chrome (it fails on Chrome for Android latest too)..
Re:Show HN: A simple IP address API
by atmosx on Saturday February 15, 2014 @12:55PM
(#7244557)
Thanks for that! I'm building a small script which may evolve in a service and I was retrieving IP addresses using curl, this is way more clean. Thanks!
Re:Show HN: A simple IP address API
by welterde on Saturday February 15, 2014 @01:41PM
(#7244741)
IP addresses should only be announced by one ASN at a time (regardless if that AS is multihomed or singlehomed). If that's not the case that's usually a hint of prefix hijacking.
Re:Show HN: A simple IP address API
by girvo on Saturday February 15, 2014 @01:32PM
(#7244714)
/waves at another Brisbanite on HN
It gets my Location wrongish here on the Gold Coast, but not too far out. We have huge suburbs though, all of the GeoIP DB's seem to think im in the wrong suburb, despite having a static IP on Telstra cable.
Re:Show HN: A simple IP address API
by disbelief on Friday February 14, 2014 @01:09PM
(#7239963)
I just finished integrating geo IP lookups into an app I'm working on, using a library that queries a number of the free IP lookup services out there. Something that I've learned from this is just how hard it is to stay on top of IP geolocations. Most of the free services use incomplete or outdated databases, and if you want decent accuracy you probably need to opt for a paid package from a company who has the resources to track IP address location changes, and keep their database up to date.
So, I'm wondering, does ipinfo.io maintain their own database, or do they sub-license someone else's database? If they're maintaining their own, how good are they at keeping it valid and updated and what is the coverage like?
Re:Show HN: A simple IP address API
by msumpter on Friday February 14, 2014 @01:18PM
(#7240023)
I was trying to figure out which database they were using as well. I've checked their results for my IP address against the results from MaxMind's GeoIP City and GeoIP2 City service and these return the closet results related to the Latitude/Longitude displayed on ipinfo.io, it also has a matching zip code. The network name differs since I'm on U-Verse but I think they are just displaying the company name from the ASN. I also checked Quova/Neustar and the results are vastly different.
Re:Show HN: A simple IP address API
by Gys on Friday February 14, 2014 @01:17PM
(#7240016)
It uses one of the free databases that are available.
Ip address 200.7.52.1 is a good way to check these services. This should position to the island of Sint Maarten. A serious offering would know that. The free ones always set the position to Curacao. Just about 900 NM away...
Re:Show HN: A simple IP address API
by throwaway420 on Friday February 14, 2014 @01:36PM
(#7240134)
This looks very well done and useful.
Usually though I just use http://www.moanmyip.com for the weirdness of it. Or pretty much any search engine includes that up top when you search for "ip address".
It provides response formats: xml, json, csv, newline separated, serialized php. And enforce a limit of 240 requests per minute (that's 14,400 per hour for the lazy).
Fun fact, if you're running tor (tor-0.2.4.17 as proxy not the browser) you'll see the tor exit node in "IP:" and your actual ip i "Real IP:", thanks to gdns' EDNS (https://gdns.re/edns-demo/)
Re:Show HN: A simple IP address API
by dfc on Friday February 14, 2014 @10:31PM
(#7242549)
Fun fact: if you are running tor and you see the tor exit node and your IP you are doing it wrong! You are leaking DNS requests. Tor goes to great lengths informing you that something is wrong in the logs. This is not thanks to edns, it is thanks to your inability to use the software correctly. Please see:
Re:Show HN: A simple IP address API
by msantos on Saturday February 15, 2014 @06:12AM
(#7243438)
>it is thanks to your inability to use the software correctly
I disagree, but have you said it is down to my inability to explain what the problem is, then I agree.
I'm aware of the DNS leaks, and obviously wasn't clear enough and failed to explain what the problem was.
The leak only happens when you run the tor proxy daemon, and your own browser with the appropriate proxy settings.
It's down to the way Firefox, uses the defined proxy for the initial DNS and HTTP requests, but then bypasses it when doing DNS lookups for JS within the initial page loaded.
It doesn't leak DNS lookups made by JS scripts if you use the tor version that includes a mod-Firefox browser.
Re:Show HN: A simple IP address API
by squeed on Friday February 14, 2014 @05:05PM
(#7241321)
I don't mean to be a huge jerk - I think the service is cool - but IPv4 exhaustion is months away! All of the major GeoIP vendors have IPv6 support. It's simultaneously saddening and frustrating that it might as well not exist.
Re:Show HN: A simple IP address API
by lsc on Saturday February 15, 2014 @06:13AM
(#7243439)
For ARIN (where most of us will be getting our IPs) projected runout (assuming no "bank run") is closer to a year out[1]
Now, people /have/ been predicting some crazy run on IPv4 for some time now, I was pretty certain it was going to happen in 2011 and while a run is still quite possible, it hasn't happened yet, and there are a bunch of outstanding /8s that could very well be returned; the DoD has been returning blocks, and they still have a bunch more they could return. Based on my own previous expectation that runout was going to occur in 2011, I'd be surprised if we run out before 2015.
Now, if you are dealing with network admins and infrastructure types? IPv6 is very important. I give my customers an IPv6 address by default, and will give a /64 upon request. It's pretty important for the sort of people I have as customers.
You see, we're the ones who have to deal with this 'nat hell' - and make no mistake about it, it will be hellish.
However, from a business perspective? If you are going after business types? The internet is still entirely IPv4.
Re:Show HN: A simple IP address API
by jfasi on Friday February 14, 2014 @12:10PM
(#7239569)
This is interesting. IP address databases are typically bought and sold for figures in the thousands. This service presumably purchases one or some of these and attempts to make up the cost by providing it on an as-needed basis.
I wonder if there are any additional data sources that can just be bought wholesale and sold in pieces? Think of all the applications that needed very precise IP address data but couldn't afford the whole dataset. They can now exist!
I could also be wrong and this isn't at all the approach this service takes...
Re:Show HN: A simple IP address API
by nly on Friday February 14, 2014 @12:28PM
(#7239683)
> IP address databases are typically bought and sold for figures in the thousands.
And presumably, therefore, issued under licenses that forbid you from starting a query service? I'm pretty sure most of these IP data providers will offer their own on-demand query services
Re:Show HN: A simple IP address API
by Erwin on Friday February 14, 2014 @01:29PM
(#7240089)
That's for your own use however, the license says:
Access to the data is restricted to employees and contractors of the license holder. With contractors, the license holder is liable should the contractors violate the terms of the agreement.
Data may not be stored in a way that is publicly accessible.
Re:Show HN: A simple IP address API
by hox on Friday February 14, 2014 @01:58PM
(#7240297)
This really looks like maxmind city level, so... until we get confirmation from the dev on what db it is, assume this service can disappear at any moment due to license issues.
Re:Show HN: A simple IP address API
by chbrown on Saturday February 15, 2014 @12:25AM
(#7242770)
About 8 miles less accurate than MaxMind -- 11 miles wrong vs. Maxmind's 3. I'm always curious: what is the provenance of services like this one / MaxMind — my ISP? Some past inadvertant GPS-enabled requests that leak out?
Re:Show HN: A simple IP address API
by hox on Friday February 14, 2014 @01:47PM
(#7240211)
And presumably this service is just repackaging such an existing system. My old company had a tool to figure our what widely used geo db was used for these services (to properly judge it's value), but I no longer have access to this tool.
Re:Show HN: A simple IP address API
by whitehat2k9 on Friday February 14, 2014 @11:49AM
(#7239446)
I'm on a campus network that reverse proxies all HTTP traffic. The service shows my internal 10.x.x.x IP. Just a heads-up that you might want to fix your handling of X-Forwarded-For headers.
Re:Show HN: A simple IP address API
by coderholic on Friday February 14, 2014 @12:21PM
(#7239638)
Thanks for reporting! You should see that we correctly detect this as a bogon, but we should definitely be pulling the correct IP from the headers. I'll look into this.
Re:Show HN: A simple IP address API
by jfasi on Friday February 14, 2014 @12:12PM
(#7239579)
Recommendation: I have the feeling your sales would be significantly boosted if you added some sort of tiered service plans on top of your free tier, instead of requiring the frictionful process of reaching out to a sales address.
Re:Show HN: A simple IP address API
by ytjohn on Saturday February 15, 2014 @07:14PM
(#7246095)
My "goto" for shell scripts is http://echoip.org/, though I recently setup my own such script as well. It's a one-liner in PHP, though having some json output alternatives would be useful as well.
Re:Show HN: A simple IP address API
by lpgauth on Friday February 14, 2014 @03:59PM
(#7240955)
Has anyone done research on quality of geo DB? I've personally prefer Maxmind because of the format of the DB, but Netacuity seemed to be giving more up to date results.
Re:Show HN: A simple IP address API
by mappu on Friday February 14, 2014 @05:10PM
(#7241354)
My first guess would be that the domain uses a custom nameserver that logs all dns queries and serves back a different IP to each user. Then when the http request comes in to that specific IP, it can check the dns logs to identify the resolver.
But surely.. that would either require (a) a massive IP space (i guess that works if the site is IPv6 only), or (b) assuming a pretty short time between dns lookup and http request, and hence possibly false results if the dns lookup is cached somewhere and the IP has since been reused
I'd love to know if there's a better way of implementing this.
Re:Show HN: A simple IP address API
by 0x0 on Friday February 14, 2014 @09:09PM
(#7242331)
A better way would be to hand each client a unique hostname (sessionidhere.whatsmyresolver.stdlib.net) and match that dns query to the http client? For example as an ajax call from the main website.
Re:Show HN: A simple IP address API
by gedrap on Friday February 14, 2014 @12:48PM
(#7239828)
This believes that I am in Colchester, FreeGeoIP can say that I am just in the UK, Google in incognito mode thinks that I am in Sheffield. Correct answer: Manchester :)
Re:Show HN: A simple IP address API
by lifeeth_ on Friday February 14, 2014 @03:14PM
(#7240730)
Paid plan for API access I guess - hoping one wont use the same environment for both. I meant this for the stripe frame which kicks in, cant really trust an https frame that has a start from http.
I was at one point using https://github.com/tjfontaine/node-dns for the hostname lookups, but it was significantly slower that the built in dns module, so I ended up wrapping that with my own timeout logic.
http://www.maxmind.com/en/city http://nginx.org/en/docs/http/ngx_http_geoip_module.html
Imagine you want to redirect users to the correct country page in your site. In this case you need to get access to the ip geolocation in real time. GA won't help you there.
http://www.maxmind.com/en/geolite_city_accuracy
It's less accurate than their commercial offering, but good enough in many cases. For ease of use, there's a nice C API (https://github.com/maxmind/geoip-api-c) and wrappers like pygeoip for Python.
https://github.com/fiorix/freegeoip/issues/32
Anyway, this 'quality' should be free anyway ;-)
Why not check both rather than just one?
ipinfo.io thinks I'm in Brisbane, which is slightly more accurate (although also less specific), although still about 25km out.
It gets my Location wrongish here on the Gold Coast, but not too far out. We have huge suburbs though, all of the GeoIP DB's seem to think im in the wrong suburb, despite having a static IP on Telstra cable.
I use it for my bitcoin client: https://github.com/bit-c/bitc
So, I'm wondering, does ipinfo.io maintain their own database, or do they sub-license someone else's database? If they're maintaining their own, how good are they at keeping it valid and updated and what is the coverage like?
Ip address 200.7.52.1 is a good way to check these services. This should position to the island of Sint Maarten. A serious offering would know that. The free ones always set the position to Curacao. Just about 900 NM away...
http://myip.ms/info/whois/200.7.52.1
I posted this for a friend: https://twitter.com/coderholic
He's the guy behind Lighbox.com which Facebook acquired, really awesome guy!
I guess he'll be wondering where all the sudden traffic is coming in from!
Usually though I just use http://www.moanmyip.com for the weirdness of it. Or pretty much any search engine includes that up top when you search for "ip address".
It provides response formats: xml, json, csv, newline separated, serialized php. And enforce a limit of 240 requests per minute (that's 14,400 per hour for the lazy).
Fun fact, if you're running tor (tor-0.2.4.17 as proxy not the browser) you'll see the tor exit node in "IP:" and your actual ip i "Real IP:", thanks to gdns' EDNS (https://gdns.re/edns-demo/)
https://trac.torproject.org/projects/tor/wiki/doc/Preventing...
I disagree, but have you said it is down to my inability to explain what the problem is, then I agree.
I'm aware of the DNS leaks, and obviously wasn't clear enough and failed to explain what the problem was.
The leak only happens when you run the tor proxy daemon, and your own browser with the appropriate proxy settings.
It's down to the way Firefox, uses the defined proxy for the initial DNS and HTTP requests, but then bypasses it when doing DNS lookups for JS within the initial page loaded.
It doesn't leak DNS lookups made by JS scripts if you use the tor version that includes a mod-Firefox browser.
Now, people /have/ been predicting some crazy run on IPv4 for some time now, I was pretty certain it was going to happen in 2011 and while a run is still quite possible, it hasn't happened yet, and there are a bunch of outstanding /8s that could very well be returned; the DoD has been returning blocks, and they still have a bunch more they could return. Based on my own previous expectation that runout was going to occur in 2011, I'd be surprised if we run out before 2015.
Now, if you are dealing with network admins and infrastructure types? IPv6 is very important. I give my customers an IPv6 address by default, and will give a /64 upon request. It's pretty important for the sort of people I have as customers.
You see, we're the ones who have to deal with this 'nat hell' - and make no mistake about it, it will be hellish.
However, from a business perspective? If you are going after business types? The internet is still entirely IPv4.
[1]http://www.potaroo.net/tools/ipv4/index.html
I wonder if there are any additional data sources that can just be bought wholesale and sold in pieces? Think of all the applications that needed very precise IP address data but couldn't afford the whole dataset. They can now exist!
I could also be wrong and this isn't at all the approach this service takes...
And presumably, therefore, issued under licenses that forbid you from starting a query service? I'm pretty sure most of these IP data providers will offer their own on-demand query services
Access to the data is restricted to employees and contractors of the license holder. With contractors, the license holder is liable should the contractors violate the terms of the agreement.
Data may not be stored in a way that is publicly accessible.
If you wanted to build a public server with that, you would have to use their per-usage API according to their FAQ: http://www.maxmind.com/en/faq#lookuptool
Also, I wonder if it handles X-Forwarded-For headers that contain multiple IP addresses, because there are multiple levels of proxying taking place.
Also. No IPv6? How boring.
"127.0.0.1 is a bogon or private IP address that should not appear on the Internet."
But then I learned that "bogon' is actually a word:
http://en.wikipedia.org/wiki/Bogon_filtering
And re-reading the sentence, I'm not sure what "bogon" would be a typo for anyway..."Vogon"? Anyway, good handling of an edge/nonsense case!
I'll probably be using this. Thanks!
At least it got the US part right.
JSONP support: http://ipinfo.io/?callback=test
Paid JSONP support: https://ipinfo.io/?callback=test
Thanks.
It merely does legacy IP, so what's the point?
Why not just use Maxmind though?
I'll go ahead and file an issue with the github lib.
But surely.. that would either require (a) a massive IP space (i guess that works if the site is IPv6 only), or (b) assuming a pretty short time between dns lookup and http request, and hence possibly false results if the dns lookup is cached somewhere and the IP has since been reused
I'd love to know if there's a better way of implementing this.
FreeGeoIP thinks I'm in Edinburgh, which is only slightly better.
Ideally they should be on separate domains, at which point HSTS would be more suited.
* Courtesy of Wappalyzer
The code is written in coffeescript, and some key npm modules are:
- https://github.com/caolan/async
- https://github.com/brycebaril/node-tokenthrottle-redis
- https://github.com/rs/node-netmask
I was at one point using https://github.com/tjfontaine/node-dns for the hostname lookups, but it was significantly slower that the built in dns module, so I ended up wrapping that with my own timeout logic.