That being said, it doesn't have to be some kind of formal thing; the best cover letters I've read just let me know that someone has actually read and comprehends our requirements and their cover letter should tell me a few things that sets them apart from the other torrent of resumes that I'll see.
In other words, it's obvious that you're applying for this position, and not just every position you see. Just like an employee wants to think that an employer has hand selected them to work there, instead of just saying "you'll do"; an employer likes to think that the person actually cares about what they do and where they work.
"Your job listing mentioned that you need a team leader for a new application to run on mobile phones. I've led three teams in mobile application development, and all projects launched on time."
Etc...
All of these points are great ways to show your attention to details.
I'm sure you used to be able to get away without cover letters, but today there will be many more applicants than jobs; and I honestly won't even look at a resume without a cover letter now.
Of course, it's much better to do something so that you don't need a resume any more; then you don't have to do the song and dance. Network well, write a blog or release some code; all are great ways to get known.