For me, while I did learn colemak on a different physical layout, my typing speed on qwertz still plummeted. Maybe the difference wasn't large enough because it was just a columnar layout and not a split design. I spent a couple of months using both regularly though, and now I can comfortably switch between them.