I think many would agree that kind of 'law breaking' should be cleared, and they apply the same logic to non-violent drug offences.
There is also a good segment who were forced into plea bargains due to the structure of the US legal system, the pattern of racism in arrests, convictions, evidence planting and so on. We know a chunk of those people are in jail for bullshit reasons, and thus the push towards releasing these people and removing the records.
But, you say, they are the kind of people who disregard the law so we should keep them there anyway. They are in prison because of a specific crime, not their general audacity to defy the state. Imprisoning someone because of an error and continuing to do so after it has been realized serves no societal purpose and is a cruel and excessive use of force.
Of course, that's a very broad way to think of it. I'm sure for this particular topic there are lots of cases of outright discrimination which means people are serving sentences for marijuana-related laws that just aren't helpful to society at all (probably detrimental).
So, you may be right regarding this particular law, however, I think it is a very dangerous precedent to simply pardon anyone who committed a crime, for which that act is now legal.
If someone believes something that's currently illegal should be made legal, there are non-anarchist ways to deal with it than simply disregarding authority and committing a crime.