I think almost everyone actually understands that. What I'm not sure about is whether most of the people who say that are clear on the fact that may not be a bad thing.

Frameworks can have their own complexity and developer overhead, they can demand you spend more time solving the problems they impose (cough AngularJS), they can be ill-suited to the requirements and/or problem domain you're working in.

Building your own isn't always the sensible choice, but it can be.