It's fine if you substitute it with something that is equally or more pleasurable. There's no rule that you have to get part of your life satisfaction from food