Guilt requires an ability to act on it to be meaningful. It's meaningless to put guilt on people without such ability: they can't act on it anyway, similar to how it's meaningless to scream at a wall.