News for hackers. Stuff that matters.
Re:Your tl;dr by an ai: a deep reinforced model for abstract... by projectorlochsa on Sunday May 14, 2017 @04:24PM (#14337385)
Well, BLEU is non-differentiable and not decomposable over sequence of translation decisions. Yet I wouldn't call methods reinforcement learning because loss is tricky.

But yeah, I guess there's more to it than meets the eye.

Re:Your tl;dr by an ai: a deep reinforced model for abstract... by andreyk on Sunday May 14, 2017 @11:01PM (#14338854)
I suspect (I have not read that much NLP literature) that BLEU is typically used as evaluation only, not as the training loss. eg Google's "Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation" mentions directly optimizing for BLEU, but again via RL and not supervised learning. It certainly is a quirky example of RL, though... guess that's the pace new ideas/approaches are introduced these days.