News for hackers. Stuff that matters.
Re:Ask HN: what features do you want in a geocoder? by thomersch_ on Monday May 12, 2014 @10:41AM (#7732925)
God, no. Everyone is trying to build a Geocoder and everyone is failing, because no one is actually realizing that geocoding is probably the most complex topic in GIS.

"Yeah, let's put some Elasticsearch and PostgreSQL and it will work out fine." No, it won't - you have no idea. And of course you won't believe me, but let me list some problems you will have that you don't realize right now:

* There is a lot of different charsets. Latin, kyrillic, there are umlauts, RTL, weird abbreviations, language standards that you don't know, because you don't know enough about foreign cultures.

* It's a shitload of data: OpenStreetMap is expanded about 700 GB large (not including history). And you will want to have autocompletition or autosuggestion, so response times will have to be < 100 ms.

* Ranking. Your user types "Tokyo". Is it the restaurant next to the user, is it the capital of Japan or is it some village next to Shitfuckistan?

No matter what, it will take you about a year to get any usable result. So I suggest you to look into Nominatim (the standard geocoder of OpenStreetMap which has actually got a lot better) or Photon (a geocoder based on the Nominatim DB, but with auto suggestion).

Re:Ask HN: what features do you want in a geocoder? by amiramir on Monday May 12, 2014 @11:44AM (#7733399)
Another new player that looks promising is Pelias (http://mapzen.com/pelias/). Early days but it's open source (https://github.com/mapzen/pelias) and it seems to be improving at a good clip.
Re:Ask HN: what features do you want in a geocoder? by nodata on Monday May 12, 2014 @10:53AM (#7732997)
> or is it some village next to Shitfuckistan?

Wow, where did that come from?

Re:Ask HN: what features do you want in a geocoder? by natch on Monday May 12, 2014 @11:33AM (#7733302)
I'm going to guess it comes from the frustration of getting dumb results rankings that don't take into account the likelihood that the result is actually something you wanted.
Re:Ask HN: what features do you want in a geocoder? by tekknolagi on Monday May 12, 2014 @12:13PM (#7733594)
Re:Ask HN: what features do you want in a geocoder? by ronaldx on Monday May 12, 2014 @10:45AM (#7732955)
Agree that Nominatim is awesome. The way it handles disambiguation is thoughtful.

In my opinion, it's better than any closed source competitor.

Re:Ask HN: what features do you want in a geocoder? by freyfogle on Monday May 12, 2014 @10:55AM (#7733009)
Thanks, but it's too late, we're fallen under the geo spell. We're very familiar with nominatim (it's many strengths, but also significant weaknesses), and the challenge of geocoding across many different parts of the world, which as you mention are not trivial.
Re:Ask HN: what features do you want in a geocoder? by ronaldx on Monday May 12, 2014 @11:13AM (#7733161)
Geocoding is a problem that needs to be solved well once, and open for everyone to use.

Since you seem to share Nominatim's goals, why have you decided to create your own solution rather than work to improve Nominatim's weaknesses? Genuinely curious.

Re:Ask HN: what features do you want in a geocoder? by freyfogle on Monday May 12, 2014 @11:43AM (#7733391)
What makes you think we will not be working with and improving nominatim, or many of the other good open tools and datasets (for example geonames to mention just one of several)? Sorry if I've implied that.

For some context, my company, Lokku, has sponsored many a SotM (including the first one in 2007, and we're sponsoring SotM-EU next month), has repeatedly donated what I like to think are significant sums to the OSM foundation, and this year our company xmas gift to clients was a donation on their behalf to HOT-OSM. We're members of the UK's Open Data Institute, were one of the first companies to move to using OSM tiles in place of Google, run #geomob (a geo innovation meetup in London, hope to see you at our next one which happens to be tomorrow), and actively invest in geo start ups like SplashMaps. So I think I can safely say: we get it.

We've looked at nominatim and contributed to the code. Like any complex codebase it has strengths and weaknesses. It is a significant improvement on what came before, congrats to all who contributed. It does not follow from that that all effort at inventing a better future has to fall under the nominatim umbrella.

My question is not should we try to build a better geocoding service (be it an extension of nominatim, a replacement of nominatim, or whatever) It is what would it look like?

Some links to the various points above about what we've been up to at Lokku http://geomobldn.org/ http://blog.lokku.com/post/77055320403/investing-in-splashma... http://blog.lokku.com/post/70479246283/donating-to-the-human...

Re:Ask HN: what features do you want in a geocoder? by ronaldx on Monday May 12, 2014 @04:05PM (#7735104)
> It does not follow from that that all effort at inventing a better future has to fall under the nominatim umbrella.

But that is exactly what I'm asking you. To put it simply: Why does this not follow?

It seems to me that it would be far better if everyone was working in the same direction, rather than forking the effort.

If you have some specific/commercial application in mind, I would understand, but this seems to contrast with your general request made here.

Re:Ask HN: what features do you want in a geocoder? by freyfogle on Monday May 12, 2014 @05:53PM (#7735625)
I guess we just differ on philosophy. I think a diversity of approaches leads to more positive outcomes. Why limit ourselves to the structure and mental paths that are already there? In the same way that OSM has many editors, each with strengths and weaknesses, why should it have only one geocoder? That said, rest assured we have no plans to fork nominatim.
Re:Ask HN: what features do you want in a geocoder? by ronaldx on Monday May 12, 2014 @06:26PM (#7735756)
I don't think we differ on philosophy... clearly there are different geocoders which are competing and I am interested to know more about what you're doing. That's why I'm asking about your motivation.

If you think the problems with Nominatim cannot be overcome within Nominatim, what makes you think that you can do as good a job and overcome those problems without Nominatim? That doesn't fully make sense to me yet.

I've annoyed you enough, sorry :) Thanks for your patience.

Re:Ask HN: what features do you want in a geocoder? by randyme on Monday May 12, 2014 @02:36PM (#7734573)
Nominatim is not built to handle autocomplete, which is a requirement for many consumer apps. Thus the focus on Lucene, where you get that for free, instead of building your own fulltext search on top of PostGIS.