Re:Pattern - Web Mining Python lib
by enjo on Sunday October 14, 2012 @02:34PM
(#4652123)
Better yet: Is there a well defined structure for other folks to add that stuff?
[ Parent
| on HN ]
Re:Pattern - Web Mining Python lib
by fooandbarify on Sunday October 14, 2012 @05:25PM
(#4652698)
I'm not one of the authors, but the code in question is all in one file: https://github.com/clips/pattern/blob/master/pattern/web/__i...
It would be fairly straightforward to add your own class.
Whoa, modules with dozen of classes and 2450 lines of code! They definitely don't rely on file-navigation.
Project is great, but I've got a feeling that many smallish components have been already implemented, but here they were rewritten from scratch.
Re:Pattern - Web Mining Python lib
by rabidsnail on Sunday October 14, 2012 @07:18PM
(#4652951)
Is it just me or are they rerlolling requests and lxml for no good reason?
Re:Pattern - Web Mining Python lib
by tomdesmedt on Sunday October 14, 2012 @08:46PM
(#4653176)
The source code has a base SearchEngine class and a Result class, which streamline the input and output parameters across different web services, so it is not difficult to add new services (= subclass of SearchEngine). There are also some general developer docs: http://www.clips.ua.ac.be/pages/pattern-dev