I don't really disagree, but I think you've set up a bit of a strawman - in the general case I think one is more often harder than the other. You can obviously look at extreme outliers for contradictory examples, but the general case is more interesting/common.
There are also some things that are harder or easier for people because we have innate hardware for certain things. Recognizing facial expressions (or really interpreting any sort of visual input) compared to doing complex math in your head. The Type 1 vs. Type 2 systems from thinking fast and slow - some things are generally easier for humans compared to other things.
It's fallacious to think that one type of action can be harder than another type of action, when within each class of actions there is a wide variation in difficulty. Thinking from first principles is not harder than memorization when the first principle is Newton's first law and the memorization is every chemical component of cellular metabolism. Another example of the fallacy would be thinking that the humanities are innately easier than physics: sure, a two-page essay is easier to write than a two-page solution, but you can go in and crank up the number of pages per day a humanities professor is expected to write until it is as hard as you want (it turns out that to some extent this has already happened, you would be surprised if you found out exactly how much output they are expected to have).
In physics, the memorization is easy and the first principles are hard. In biology, the memorization is hard but the first principles are few. That's the origin of why people with biased strengths are better suited to one or the other.