I had the same experience. Once I figured it out though, it made for a really fun mechanic. Better I think than what I expected (that I could "enter" the tile from any direction).