Agreed. Paper filter is way better. Getting good quality filters makes a difference too, there are a lot out there for Aeropress, Chemex, etc.

Anecdotally I had some cholesterol issues and found that going to paper of metal made a difference, surprisingly. Probably not significant but seemed to help in my case (I was drinking a lot of coffee then). Now I can't stand the oily texture of a French press.