Women's suffrage and laws prohibiting slavery are modern but are not modern annoyances.

Your second point is already addressed: learning a new field of mathematics or science can be deeply frustrating and requires grit. The automation of daily chores does not necessitate the death of annoyance or grit.

Just like people still work hard every day even though farming highly automated.