If you make a game that is 4D, you can visualize moving 4-dimensionally via a 3 dimensional shadow. See the book Flatland for more concepts like this if this sounds interesting.

Now you can get quite good at predicting where you will end up after a while, and even be able to remember how to get places. But does that mean you are thinking 4 dimensionally? No, you’re still thinking in 3 dimensional shadows.

I get the feeling that is analogous to what happens when you try to do what you’re describing.