> Or I could be misunderstanding something about solar panels - do they continue to charge even without direct visible light? I don't know much about them.

They diminish output in proportion to the amount of light. In a charging situation where you require at least a certain voltage to push anything into the batteries, I presume it will just stop charging well before the panels are 100% dark.