If we move around in space-time we can obtain much more information about the surrounding space-time than by just watching it. For example swimming is very different in a curved than in a noncurved space (-> here a website where observations are made how swimmers move around in various environments).
However linking sensoric information with motoric information, like in computer science applications is a very difficult task. The library on the website of David Philipona of the Laboratoire Psychologie de la Perception has a good collection of links, like for example to the Max-Planck-Institut for Biological cybernetics with its famous virtual treadmill project cyberwalk.
The group at the Laboratoire did some works in order to find a mathematical formulation of how to gain information about the surrounding space via sensoric/motoric information, like e.g. in their paper
Perception of the structure of the physical world using unknown multimodal sensors and effectors