Re:HNSearch API Contest
by andres on Saturday June 04, 2011 @06:55PM
(#2620661)
Has someone written a crawler for the forum? If so, I can help with the ThriftDB setup.
[ Parent
| on HN ]
Re:HNSearch API Contest
by evanrmurphy on Saturday June 04, 2011 @07:00PM
(#2620675)
That would be amazing! I think there have been at least a couple crawlers written for it. (One being SearchYC's.) I'll let you know when I find something more concrete.
Is there anything else that would help make the ThriftDB setup go more smoothly?
I don't think so. Once we have the data it'll be easy to upload it. I'm emailing with the SearchYC creator so I'll ask him about arc forum data.
Re:HNSearch API Contest
by evanrmurphy on Saturday June 04, 2011 @08:58PM
(#2620928)
Kartik is happy to contribute his crawler, but wonders if it wouldn't be easiest to reuse the HNSearch crawler (since both forums have the same structure). http://arclanguage.org/item?id=14774
Re:HNSearch API Contest
by evanrmurphy on Saturday June 04, 2011 @07:15PM
(#2620706)
Thank you, Andres. I put up a message about it on the Arc Forum as well: http://arclanguage.org/item?id=14772. Please email me at [email protected] if you need assistance.