There's a natural limit to size due to the square-cube law. An increase in height leads to a cubed increase in mass which means they are pretty quickly too large and require too much energy to sustain themselves.