Gandhi said, "Whatever you do will be insignificant, but it is very important that you do it."

You are technically correct. Almost no election is changed by the result of a single person. However, if everyone who thought this way chose to vote anyway, they could collectively swing every election.