Although "its" is also possessive you don't use an apostrophe because that would confuse its with "it's"
Then if the word ends in an s the rules are different unless it's a name, then the rules are different again, unless it's a biblical name then the rules are different to the last rule, except for Moses and Jesus which are exceptions to this. Then of course there are always a few special cases - St James' park (footbal ground) but St James's park (park)
Of course if the word originally comes from another language then you have to use the rules from the language instead, well sometimes, say for French but not German or Dutch, actually only sometimes for Dutch depending.
Why doesn't this mistake carry over to the gendered forms? That is, why don't people write "hi's" or "her's"?
Couldn't make heads or tails of his writing. Maybe because it's shifted so much in the intervening centuries that it's only marginally comprehensible to someone who learned the modern tongue?
How has Gutenberg changed the rate of change in languages? Has greater availability of printed materials held things steady longer?
How is the Intertubes changing this? Has the ability to instantly view the work of people representing a zillion languages accelerated change?
The value of the words in the dictionary stems from their widespread use. Intrinsically, they don't have any.