I would strongly recommend tackling Issac Asimov's 'Foundation' series as one of the all time classics.
Another pretty early one to take a look at is 'We' by Yevgeny Zamyatin. It was the first book banned by the USSR and was the inspiration for Orwell's 1984.
Anyway, Frankenstein was one of the cornerstone texts of that course, and you can clearly see many of the themes of later SF being developed by Shelley. We also read Dr Jekyll and Mr Hyde in that course, plus some early Australian SF (like Picnic at Hanging Rock). It was all pretty interesting, but a long way from the space opera that is one of the cornerstones of modern SF. I just don't feel like you can experience SF unless you've read some of the bigger more sweeping stuff, like Hyperion or Pandora's Star.
I had not heard of We, but I will look into it.
Asimov: The Gods Themselves
Clarke: Childhood's End, Rendezvous with Rama
Herbert: Dune, Whipping Star
Bradbury: Fahrenheit 451
Bester: The Demolished Man, The Stars My Destination (also called "Tiger, Tiger")
Niven: Ringworld
Niven and Pournelle: The Mote in God's Eye, Footfall
Gibson: Neuromancer
Stephenson: Snow Crash, The Diamond Age
Bear: The Forge of God, Eon
Sagan: Contact
van Vogt: The Voyage of the Space Beagle
Lem: Solaris
Atwood: The Handmaid's Tale
LeGuin: The Left Hand of Darkness
Lewis: Out of the Silent Planet
Some of these are the beginnings of series or have sequels, or exist in a larger continuum of stories. But each can be read and appreciated on their own. If you find one you really like, it's not hard to see if there are more in a series or sequel.Edit: formatting
Also, you have to hit the short-story collections to find some of the best sci-fi. Off the top of my head, Asimov, Dick, Bradbury, Clarke, Gibson, Banks, Egan, all wrote some of their best work in short form.
And, just thinking about really early stuff, 'Flatland' by Edwin Abbott is another you should really take a look at.
If you want to try any recent stuff, Alastair Reynolds and China Miéville are both excellent authors.
edit - oh, and just read everything ever written by Neal Stephenson.
edit2 - and Bruce Sterling. His tumblr blogs aren't bad either.
Science fiction (or speculative fiction, if you're feeling highbrow) is probably one form where I still regularly buy "Year Best <whatever>" anthologies...it's a form that is benefited heavily from short stories, because scifi is about the ideas, not so much the characters. Good science fiction has both, of course, but must have good ideas--lots of stories happen that have decent character development but the ideas stink.
I also would strongly recommend the Pump Six anthology by Paolo Bacigalupi; it's biopunk, I suppose, but pretty solid and plays well with the ideas of being past Peak Energy.
I recently finished "Roadside Picnic" by Arkady and Boris Strugatsky and I loved it. Makes me curious to read other sci fi from the Soviet world.
A long time ago, I read that Asimov's short story 'Nightfall' was considered the finest short SF of all time, but I respectfully disagree. Nine Minutes, by Genrikh Altov, is that story for me. Link: http://www.altshuller.ru/world/eng/science-fiction4.asp
Also - a truly awesome novel - 'Self Discovery', by Vladimir Savchenko (also in the Macmillan series). (Link: http://lib.ru/RUFANT/SAWCHENKO/savchenko_selfdiscovery_ok-en...) It has one of the most compelling, and fascinating, descriptions of AI I've ever come across. As Theodore Sturgeon writes in the introduction, 'described with such realism that one is tempted to apply for a grant, build it, and check it out.'
If you want more military sci-fi, check out the Hammer's Slammers series by David Drake (tank company in spaaaaaace, but not the stupid Bolo stuff); he also had one anthology that was very nearly solid cyberpunk surveillance dystopia, Lacy and His Friends.
I still have fond memories of Smith's galaxy-spanning Skylark series, the planet bashing swagger of the Lensman series, and Campbell's unapologetic "super science", but the prose has not aged well and I find them difficult to read now. I feel a little sad about that.
I can still recommend Smith's The Skylark of Space and Skylark Three, and Campbell's The Moon is Hell, but not much else.
If you like it you can check out the rest, if not then they're only short stories so not too much of an investment in time.
Here's a (probably pirate?) link: http://lib.ru/GIBSON/r_contin.txt
EDIT: see also the Hugo Awards, which could probably do a better job of publicizing the sorce of their name.
PPS: congrats cstross for best novella! I hadn't noticed that.
By the way, if one wants to read a quick standalone sci-fi novel, I just finished Heinlein's The Moon is a Harsh Mistress, and I can't recommend it strongly enough.