News for hackers. Stuff that matters.

A comment on RWKV: Reinventing RNNs for the Transformer Era. Parent comment

Re:RWKV: Reinventing RNNs for the Transformer Era by pico_creator on Monday May 22, 2023 @11:00PM (#36039272)
RWKV has been running in public (relatively obscure to other models) for the past 2 years

Mostly lead by a single person (blink). This community consist mostly of people outside the academia / big VC tech scene

When eleutherAI offered to help us with writing the paper. Various key folks banded together for the paper, as it’s what seems to be a very strong alternative to transformers

This does not mean everyone in the discord was credited.

The requirements are for significant contributions to the paper. typically several paragraphs long worth of drafting and revisions

Just doing a line of grammar change or a single benchmark is not enough

[ Parent | on HN ]
Re:RWKV: Reinventing RNNs for the Transformer Era by pico_creator on Monday May 22, 2023 @11:05PM (#36039302)
AKA: no one here is incentivised to fight for bigger ownership, no promotion or KPI or pay was on the line
[ Parent | on HN ]