As long as you don't mind it, if it feels like you're suffering or martyring yourself you're crossing a line. You can overdo it and end up demotivated (if you're lucky) or injured (if you're not). And depending on the injury, you'll not be able to do that same sport again.