You’re absolutely right, the power draw is hugely affected by how many USB devices you attach etc. Stick with the recommended 2.5A though and you are likely to be fine. Much of the issues low power causes are often weird as well, it’s often not obvious it’s the root cause.