News for hackers. Stuff that matters.

A comment on Permutation-Invariant Neural Networks for Reinforcement Learning. Parent comment

Re:Permutation-Invariant Neural Networks for Reinforcement L... by sdenton4 on Sunday November 28, 2021 @02:17AM (#29366869)
Most actual implementations use a position encoding, though, which breaks permutation invariance. This is a good inductive bias... word order matters, for example.
[ Parent | on HN ]
Re:Permutation-Invariant Neural Networks for Reinforcement L... by bjornsing on Sunday November 28, 2021 @02:51AM (#29367031)
Sure. But it would be very weird to use a position embedding here, when the whole point is permutation invariance.
[ Parent | on HN ]