They do actually have a "delete" switch, but it's harder to find than the "deactivate" one. I've made this mistake before, then with a quick google for "deactivate vs delete facebook" I learned how to do it right.