I've had similar thoughts, and concluded that all of three different modes of mental operation have virtues and are worth spending time on: directed movement (concentration, focus), undirected movement (mind-wandering, daydreaming), and non-movement (meditation).