It's clear that there's more force on a heavier object. How much force do you have to apply to counteract a bucket full of rocks from falling to the ground, vs. an empty bucket? Your arm is certainly applying more force to the former.
So then the question becomes Why doesn't the full bucket fall faster? Because it has more inertia, and thus it's more difficult to accelerate. But there's also more force, which overcomes this difficulty. The amount of greater force is exactly identical to the greater inertia, so the acceleration remains the same. The "exactly identical" here is no coincidence.
So yeah, that makes sense.
Similarly, I only mentioned terminal velocity because I said faster. Which could apply there. But my point was focused on acceleration of falling objects. I get that there are a lot of ways to muddy that discussion. As exemplified by my postings. :).
You can say that two larger things attract each other more than smaller things. Especially as they get closer to each other. Catch, of course, is all things on the earth are in the noise range compared to, you know, the earth. If you are talking about gravity and acceleration on the earth, you are talking about 9.8 m/s^2. Pretty much period.
And yes, there are terminal velocities that impact maximum speed. Acceleration, though, is not velocity.