News for hackers. Stuff that matters.
Re:AllenNLP will be unmaintained in December by ta988 on Monday July 11, 2022 @10:34AM (#32056701)
What's a good alternative?
Re:AllenNLP will be unmaintained in December by make3 on Monday July 11, 2022 @10:47AM (#32056879)
By very far most of the work in nlp now uses pretrained models. So people use HuggingFace Transformers now. https://huggingface.co/docs/transformers/main/en/index

HuggingFace Transformers is a huge high quality open source repo of pre trained models & associated code. People combine that with Pytorch-Lightning or Fairseq most of the time afaik.

Re:AllenNLP will be unmaintained in December by toppy on Monday July 11, 2022 @10:58AM (#32057012)
I think spaCy (https://spacy.io/) is a great library for NLP
Re:AllenNLP will be unmaintained in December by marvinalone on Monday July 11, 2022 @12:03PM (#32057931)
It depends on what you use AllenNLP for. AllenNLP has a ton of functionality for vectorizing text. Most of the tokenizer/indexer/embedder stuff is about that. But these days we all use transformers for that, so there isn't much of a need to experiment with ways to vectorize.

If you like the trainer, or the configuration language, or some of the other components you should check out Tango (https://github.com/allenai/tango). One of Tango's origins is the question "What if AllenNLP supported workflow steps other than read -> train -> evaluate?". We noticed that a lot of work in NLP no longer fit that simple pattern, so we needed a new tool that can support more complex experiments.

If you like the metrics, try torchmetrics. Torchmetrics has almost exactly the same API as AllenNLP metrics.

If you like any of the nn components, please get in touch with the Tango team (on GitHub). We recently had some discussion around rescuing a few of those, since there seems to be some excitement.