"This isn't in the spec as a mandatory requirement, but if you don't do it then parts of the Fediverse won't be able to follow you."
I don't think this is true even when using AUTHORIZED_FETCH, Mastodon still displays the minimum set of Actor information necessary to complete a follow request (public key, username, etc), so I don't really know what this part of the post might be referring to.
Enabling authorised fetch breaks federation with several other servers and some apps as well. Previously valid post IDs may suddenly become unavailable or break, which some services trying to backfill posts absolutely cannot deal with.
I believe actors are available as barebones actor information not to break federation completely, but I don't believe this type of compatibility is available for individual statuses.
Personally, I don't see why I shouldn't enable the setting on my own servers because the extra control it provides is probably worth it for the few exotic broken servers out there, but it's a gotcha if you expect the protocol to work as described in the spec alone.
For example, Mastodon has some artifical requirements that add signature requirements to public APIs to reduce bot and spam load. This isn't in the spec as a mandatory requirement, but if you don't do it then parts of the Fediverse won't be able to follow you. There are also expectations attached to certain activities that aren't in the spec but will confuse people on most other servers.
The easiest solution I came up with was to run a server that already does all of the hard work (gotosocial, Mastodon, etc) and call its API to add new posts.