That's the basis for a very common VR game(s) you see in VR arcades and such (or conventions). https://store.steampowered.com/app/334540/Vox_Machinae/ or https://store.steampowered.com/app/1192900/IRON_REBELLION/

Having played them, they were slightly disorienting at first but nowhere near as actual movement-based VR games.