Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based...
by laughingman2 on Friday January 20, 2023 @06:06AM
(#34451459)
Have you checked RSSM approach in DreamerV1,V2,V3,PlaNet? It uses deterministic (GRU hidden state) and discrete stochastic latent states. The deterministic and stochastic (sampled) latent state are used to predict the next state. I think the stochastic state might help with your problem a bit.
[ Parent
| on HN ]
Re:ChatRWKV, like ChatGPT but powered by the RWKV (RNN-based...
by sillysaurusx on Friday January 20, 2023 @08:16AM
(#34452692)
Dear mystery HN’er, thank you so much. I hadn’t heard about RSSM, and your explanation was wonderfully helpful.
Much appreciated. Have a great weekend :)