Re:What Zillow doesn't want you to know about its listing gap
by troisx on Tuesday October 06, 2015 @02:37PM
(#10341262)
You could try Listhub, but they charge. Any other source would most likely not be legally obtained.
[ Parent
| on HN ]
Re:What Zillow doesn't want you to know about its listing gap
by imroot on Tuesday October 06, 2015 @04:32PM
(#10342146)
Listhub has its own problems -- specifically when MLS'es update data, Listhub has to ensure that all of the applications that use its data are updating their information as well. Listhub is also one HUGE xml file that is a pain in the ass to process. (We explored with a python based parser that chunked the file up into smaller listings and then imported that into Elasticsearch; but ultimately gave up and resorted into a C based parser that threw everything into MongoDB.
Re:What Zillow doesn't want you to know about its listing gap
by icebraining on Tuesday October 06, 2015 @05:16PM
(#10342469)
I'm curious, did you look into streaming XML parsing, StAX-style? It's not hard to process infinitely-long files with constant memory: http://stackoverflow.com/questions/9809469/python-sax-to-lxm...