> "So people start buying it, because it's going up". That's speculation.

Mostly but not entirely. It's also previous shorters who buy to manage risk. These people are qualitatively different from the speculators.