I did just test turning off webfonts on Medium and I still honestly can't see any huge problem with my default system typeface. This could possibly be because I have nice defaults, but at the same time, I think the good readability of Medium is far more about the overall style/layout of the page (particularly the decent large font-size), than about any particular typeface.
Example 1 - normal Medium: http://i.imgur.com/D4hYBPy.png
Example 2 - default system fonts: http://i.imgur.com/Jvnuhkm.png
Whilst I can see the difference in typeface, I can't honestly say that I'm experiencing any huge readability changes. Perhaps if I were to switch to a Sans of some sort, but that's not exactly a huge decision that needs to take a lot of time and fuss. By far and away the most important thing that makes this page readable and nice is the font size, closely followed by the line-width.
http://books.google.com/books/about/The_elements_of_typograp...
for a discussion of LOD in typography from a master designer)
To properly design his multi-volume set of CS/mathematics books:
http://www-cs-faculty.stanford.edu/~uno/taocp.html
Knuth developed an entire software toolchain that spans type face creation (metafont) to the document layout programming language TeX (yup, it's an actual Turing complete language!):
http://en.m.wikipedia.org/wiki/TeX http://dl.acm.org/citation.cfm?id=67555
He is also responsible for the creation of "literate programming"... All this in his spare time, of course, while he wasn't occupied with his responsibilities as a CS professor at Stanford, teaching, doing research (on things other than digital typography, e.g. the content of his books, combinatorics, etc. (...). Truly an inspiration!
Even if you cannot readily quantify the difference between, say, Roboto and Source Sans, the difference is there and your perception of either is different. The difference might be slight, but it is sufficient to skew your "2 second" impression in the wrong (or the right) direction. For example, even though Roboto and SS are almost the same typeface, Roboto in regular weight renders much heavier than Source Sans, so if you are to use for a product that is meant to exude lightness and airness, it would work worse than if you were to use SS.
Things like overall feel and the "rhythm" of a typeface take an effort to notice, quantify and rationalize, but they are of an UTMOST perceptive importance. Ever noticed the quirky lowercase "a" in Proxima Nova? Ever noticed how that "a" just steals the show if it appears in a sizes larger than 16px? No? Just pay closer attention next time ;) The same goes for HF&J's Whitney - it looks like just another sans-serif font on the surface, but it just feels friendlier. Try and quantify that (Kotaku uses it, go check it out).
First impression is hugely important and a typeface choice plays a very big part in it. Don't make a mistake of underestimating it.
My point here isn't (ahem) "You are wrong.", but more that I think you need to get some perspective about the distinction between strongly held opinion and objective fact.
https://implicit.harvard.edu/implicit/user/agg/blindspot/tab...
I went back and checked the Medium website with a handful of different typefaces on the body text, and whilst I could tell a large difference in readability between the default (ff-tisa-web-pro?) and my systems DejaVu Sans, I honestly couldn't tell the difference the default and Georgia (serif) (screenshots in another comment below).
Which brings me back to my point, that the typeface is highly overrated in importance on a page. The choice of font-size, Sans/Serif, line-height/width, etc. all play a far more important role when it comes to readability.
I will admit that I do come from a strong science/programming background, so sometimes the more arty, design side of things escape me!
At first glance, I thought the "elite" and "subtle" were both the same face, and likewise with the "informal"/"playful". It's only because they were blown up to a large size that I actually started noticing a tiny difference. Maybe it's just me?
To me, the overall layout of the page is far more important. eg. margins, font-size, line-height, paragraph width, etc.
The exception to my rule, that I might spend more time on, is for big newspaper style headlines. Those I treat more like images/artwork than like text, so they get commensurately more attention devoted to them.