I forgot to mention one thing, you can move object only if the time is freeze.
Ahh gotcha, figured it out.