If I may ask, what VR headset are you using? A lot of times Physics wonkiness is directly related to the frames per second that the game is running at. I know sometimes if a game has a physics engine coded fr 60fps then running the game at 120fps for example causes physics issues such as exaggerated force and acceleration. Not saying that is for sure the issue but I know it has been on other games with physics problems.