News for hackers. Stuff that matters.

A comment on SpaCy PyTorch Transformers. Parent comment

Re:SpaCy PyTorch Transformers by ma2rten on Friday August 02, 2019 @08:34PM (#20597832)
It's a very new thing. Pretrained ImageNet models were first released around 2011. Pretrained transformer models have only been released recently.

Also, transformers are only useful for short text, not full documents (AFAIK).

[ Parent | on HN ]
Re:SpaCy PyTorch Transformers by bigmit37 on Saturday August 03, 2019 @08:48PM (#20603758)
are transformer models are the text version of imagenet model? The first time I am hearing this term.
[ Parent | on HN ]