Unfortunately given what I do with linux in '14 I checked and per ps on one box and the VSZ of /usr/sbin/sshd is 43792K aka about 44 megs, so you'd be about 12 megs into the swap just to log in. Not that vanilla sshd is the lightest memory process out there.
Of course people did run Beowulf clusters before 2014, you'll have to run some 90s era software given 90s era specs.
My laptop doesn't have swap and only has 2GB of RAM, but it has no problem "allocating" the 3GB+ of virtual memory that the processes are using.
I looked for a "big" RSS/RSZ and found my puppet using 53 megs. On a 6 gig machine thats not a big deal, and the elimination of "by hand" administration makes it a fair trade, but on a 32 meg machine that 53 megs would be an issue.