Hey, thanks for trying it out and giving the feedback. Yes, the difference/offset in distance is by design. I want the player to experience how it is like if the visual input is not aligned with the physical world, and how usual daily tasks can become difficult because of this misalignment.
My personal tactics in terms of playing are: always hold a scroll before pressing the JUMP button, so that you know where the scroll is should be where your physical body is. And to get the next scroll (to make the task easier) I always press the RESET button to go back to the Home World (normal world) first, then grab the new scroll before the next jump.