Well there are scores of books on these issues, and some great Rabbis hold exactly what you are saying. But some say that since there is no action on the Sabbath, and the act is before the Sabbath, and before the Sabbath it wasn't an issue. So then even though the result is on the Sabbath, it's not actually an issue.