Just curious, do you have some links on handling non-stationary rewards?

I've cooked up a method of my own which I believe is theoretically sound, but I imagine there must be methods out there that don't involve solving PDEs. (Or at least simpler closed form approximations to the PDEs.)

http://www.chrisstucchio.com/blog/2013/time_varying_conversi...