It's worth it to keep exploiting transformers while doing just a bit of exploration of alternatives because they work so well. Heck, just exploiting transformers more will accelerate exploration of alternatives...