Install your custom stuff into /usr/local and never let the system package manager know about it. GNU Stow can manage self compiled binaries with ease.