News for hackers. Stuff that matters.

A comment on RWKV Language Model. Parent comment

Re:RWKV Language Model by swyx on Thursday January 02, 2025 @02:39AM (#42572544)
how about finetuning your 32B to be R1QWQKV?
[ Parent | on HN ]
Re:RWKV Language Model by pico_creator on Thursday January 02, 2025 @07:30AM (#42573857)
There is a current lack of "O1 style" reasoning dataset in open source space. QWQ did not release their dataset. So that would take some time for the community to prepare.

It's definitely something we are tracking to do as well =)

[ Parent | on HN ]