This is what I find great about US and EU (I am from Czech Republic), that in a federal system, you can test the legislation in one state first, and then see the results and this lets the other states to perhaps adopt or avoid that approach.
Unfortunately, strong moneyed interests break that model by lobbying strongly in Washington and Brussels from the start, which I think is a bad trend, but I have no idea how to prevent it. The effect of having more cultural diversity is very hard to quantify economically. (There is also other side of the coin though, which is too much state competition can lead to polarization and war.)
Although sometimes there are things where you have to be careful about this approach - for example, if one state engages in lower taxes or pro-export policies, it may gain, but the same policy enacted by everybody will make everyone lose.
Education is another with states that export there most educated population having little incentive to subsidize their higher education system. Which likely has lead to the dismantling of state funded schools as people became more mobile.
I disagree this is a necessary outcome. It may as well happen that backward states will take notice and improve their higher education system in various ways.
But I think what you are saying is a fair point and I actually mentioned it. What I would add to my comment is the common solution to this is called "principle of subsidiarity" and it's used EU and Switzerland (which is another example of a federation that often tests different law variations in smaller scale first).
I think that the A/B tests you propose would be great, though there will be plenty of ideologues still finding excuses not to accept the results.
Also, hi Nate! You probably don't remember, but you interviewed me sometime around December 2011.
For example, if you said "we're going to put twice as many cops on patrol, but we'll revoke this if crime rates don't decrease" then a rational criminal would commit more crime, in order to get the law revoked.
Or if you said "we're going to tax carbon emissions, but we'll revoke the law if domestic oil production drops by more than 20%" you've just invited oil companies to shut down their wells and wait you out.
This isn't true when the effects are measured in an industry with only several major actors. For example you decide to test out net neutrality to see what effects it has on broadband cost. So you create a bill that says "Net Neutrality unless broadband costs go up". Then Comcast could just increase their prices to deactivate the bill. But situations like these would be easy to stop and the exception.
One thing I've always wanted to see is a mandatory A/B test built into any new legislation. That is, funding for a study after X years of the new law or program being in place would have to be part of the law. It could even including a threshold of the desired controlled effect of the law or else it is immediately revoked at that point.
This way we'd force people to argue not about 2nd order issues ("I think mandatory sentencing is good" vs. "No, I think it's bad") when they could agree on first order issues ("We all want to see a 10% decrease in robberies within 3 years.") This way a bad program would automatically expire if it didn't meet its goals, and the goals would have to be open enough that people could throw out bad laws ("Goal is to incarcerate 20% of the population" wouldn't pass, no matter what your political leaning).