"The Knowledge" is not purely about memorization, there is also route planning to consider. Potential cabbies are not merely asked to quote street names and tell you where they are, they are also required to plan routes from point to point given various limitations such as road closures, etc.

It's not clear that the memorization alone would cause such changes in the brain's structure.