I notice that I have a lot more trouble trying to read Japanese in smaller fonts, but I'm also not that great at reading it to begin with.

At least Japanese has katakana & hiragana, though, which have only a few strokes and are quite prevalent in normal writing. I've seen dense walls of tiny Chinese writing that looked positively impenetrable.