I would say that Doom belongs at the top of that list.
Disclaimer: I always disliked dn3D, didn't like the mood of it.
That game changed my life. It was the most immersive, scariest thing ever. It was 4 players (not 2), and we had endless LANs and modem games. We made maps, there were whole map-making communities, whole BBSes only talking about Doom and Doom 2 and Heretic and other games based on it.. It was the biggest thing ever, even bigger than Quake in many ways because there was a lot fewer similar games at the time. I played through the single player so many times that I can revisit most maps in my mind 15+ years later...
Even the book Masters of Doom is mostly about how that game was created, rather than Quake or other id games that came before or after because Doom truly was the game changer.
I recently replayed Doom 2 with a couple of friends, and for us this is definitely a legendary game. I have lots of fond memories of Doom 1 as well. While I also spent a lot of time with Duke Nukem 3D, I never found it as enjoyable as Doom. I'd put Doom in the list before Quake.
Wolfenstein 3D should also be there.
Luckily for me, you are the one making the sweeping statement, so I only have to provide a counter-example: I remember Doom and Wolfenstein for the enjoyment they gave me. You are too quick to dismiss them :)
(And just as a matter of factual correction; Doom 1 and 2 both supported four players over IPX)
Maybe so but almost 10 years later and half-life 2 is still more enjoyable than doom3. Quake1 and quake3 are the only id games that are remembered not only for their tech advancements (and of course, commander keen).
Now if we had had source engine facial and body animations combined with doom3 engine from the beginning (and of course the much better story-writing of hl2): http://www.nofrag.com/2004/nov/24/15016/