http://www.abc.net.au/news/2016-01-02/anne-franks-diary-goes...
It's also not the US that owns the copyright but the Anne Frank Fonds in Basel, which got the copyright from her father.
Why does the copyright of where the reader lives, not where the publishing person lives, matter?
If you don't plan to travel to the US or to a country with an extradition agreement with the US concerning this you won't even need to care about that.
States want to be autonomous and set the rules that are in force in their country on their own. When you download stuff while sitting in the US, it's happening in the US. When the servers you're downloading it from are also standing in the US, like in this case, then it's even more clear that this is happening in the US.