One way to solve this, is to embed rooms into the squares, but it's wildly impractical, if played on a piece of paper. Sounds very cool and non-euclidean, though!