There's quite a few problems in traditional A/B testing. See here for example: https://volument.com/learn/problems-in-traditional-ab-testin...

I agree with some points, especially with the time frame. Sometimes traditional A/B tests take too long. Global design changes, new product launches, brand refreshing, or new information architecture are more important.

On the other hand, doing A/B tests for small changes can also have a significant impact on your overall results. I think doing A/B tests is better than not doing them at all.

Please don't use url shorteners as it obscures the destination URL. Also, preferred practice is to just some the URL as a normal submission. If you have something to add, do it in a comment on the submission.

Thanks for the suggestion! I'll keep in mind that next time.