News for hackers. Stuff that matters.
Re:Rethinking Attention with Performers by Jack000 on Monday October 26, 2020 @12:18PM (#24897790)
surprised no one's mentioned fairseq, which is probably the easiest way to train and use a transformer model. With huggingface etc you still have to write a bit of code for preprocessing input, training scheduling, batch inference and multi-gpu but fairseq has all that covered with built-in scripts.

There are no comments on this comment yet.