Indeed. Very high aspect ratio wings could be hard to make strong enough at very low weight to survive climbing through the lower parts of the atmosphere.

Some convective activity could help the climb, but it would add a lot of turbulence for the first 30,000ft or so.