I can wake up and go for a 15 mile hike with no breakfast and not feeling hungry.
Breakfast is the least natural meal, you should not even be hungry when you wake up, it's unhealthy and should be skipped.
The only broad concern I would have is being more prone to accidentally having too much calorie restriction for a prolonged period, where metabolism reduction, potential thyroid issues, and potential nutrient deficiencies can come into play based on highly individual thresholds.
I also suppose some people who fast, especially on very low carb/carnivore diets can sometimes experience the exact opposite of your concern, their blood sugar levels can become constantly elevated, seemingly induced primarily by elevated cortisol, though also seemingly effected by other complicated individual factors like the kinds of stored fatty acids they are burning.