There's a difference in actually being unreliable (which I'm sure Feynman wasn't) vs projecting the negative of "I will help everyone every time".

It boils down to finding enough courage to focus on your priorities in life and not feeling guilty about it. Respect yourself (your time) and people will respect you.