Always saying yes to "go-to person" like asks is a great way to never get anything done and never let anyone else become the "go-to person" for a particular topic. So yeah, if you don't manage it right it can cause issues, but IME being the go-to person is only half of the game: offloading your responsibilities is the other half.