Re:Go-Freeling: Natural Language Processing in Go
by mrkrwtsn on Sunday June 07, 2015 @02:21AM
(#9673616)
I'm unable to get it to run either. Turning text into tokens is something I've wanted to be able to do in golang before, so it would be super nice if it was easy to install with `go get`. I still need to work through some of the other libraries here: http://biosphere.cc/software-engineering/go-machine-learning...
I agree though, seems promising.
Re:Go-Freeling: Natural Language Processing in Go
by mschoch on Sunday June 07, 2015 @12:18PM
(#9675250)
If you just want to segment larger blocks of text into tokens you can try the segment library (it implements the word boundary portion of unicode annex 29):
https://github.com/blevesearch/segment
If you need more manipulation of tokens after segmentation/tokenization, you could look at the analysis sub-package of bleve. Its intended to be able to be used indepenently of the rest of the library.
Also, probably avoid using . imports, as it's considered a Go antipattern.
Seems really promising, but if you want it to become a project that the Go community can get behind and maintain, you'll probably want to make sure it's familiar and easy to get running. :-)