Stanza: A Python natural language processing toolkit for many human languages

Re:Stanza: A Python natural language processing toolkit for ... by JPKab on Tuesday March 24, 2020 @05:19PM (#22679135)

NLTK, for my uses, has been dethroned by Spacy for years now. I'm very curious to see how Stanza compares. It looks like it's built on PyTorch, so very interested to check it out.

[ Parent | on HN ]

Re:Stanza: A Python natural language processing toolkit for ... by staticautomatic on Tuesday March 24, 2020 @09:27PM (#22681098)

For a lot of things, yes, but NLTK still has a much bigger and better variety of tokenizers.

[ Parent | on HN ]

Re:Stanza: A Python natural language processing toolkit for ... by zwaps on Tuesday March 24, 2020 @06:57PM (#22679970)

Interestingly I had trouble using Spacy as it requires an internet connection to AWS to load their models and therefore work. This was blocked by deep packet inspection in my use case.

I looked a bit for a workaround but finally decided to just do the work in NLTK.

That's one disadvantage of Spacy.

[ Parent | on HN ]

Re:Stanza: A Python natural language processing toolkit for ... by dcsan on Tuesday March 24, 2020 @09:06PM (#22680925)

you can absolutely download the models locally:

# download best-matching version of specific model for your spaCy installation

  python -m spacy download en_core_web_sm

[ Parent | on HN ]

Re:Stanza: A Python natural language processing toolkit for ... by eindiran on Tuesday March 24, 2020 @07:15PM (#22680090)

If I recall correctly, you can pre-download the models you need, which might be suitable for your use case.

[ Parent | on HN ]