Seriously? I have in the ballpark of 180 friends on Facebook, and maybe a dozen of those are people I haven't met in person. The vast majority are either friends from real life or people from my social circle I interact with occasionally anyway. Then again, I've always treated Facebook as a fairly personal medium, and I don't friend people I don't know or don't like.
I mean, yeah, if you treat Facebook friends like pokemon, it's not going to have a lot of value for you, but if you abuse any social tool, it's not going to have a lot of value for you.
Earlier today, I found out that an old friend of mine that I grew up with is going to be in town in a couple of weeks and made plans to grab lunch while he's here. I haven't seen him in 7 or 8 years. Things like that are incredibly cool to me, and the entire reason I use social networking sites. They facilitate me interacting with people I care about; they're not a substitution for actual interaction, but they make it possible in the first place.
In short, if you really want to leave, just do it. Don't bother with being graceful; no one will notice or care for more than a minute.