The energy of (one photon worth) of electromagnetic energy does indeed increase with frequency. So green is more problematic than the same number of red photons. But you're right that if there were few green photons coming in and a ton of red, red might be blocked, and green not.