I don’t think King was arguing silence is violence. His argument was against those actively telling black people to wait, to tone things down, etc.