Thank you for the feedback! it means a lot :)
I think you are right about trying to allow interactions only when the player is in the same dimension as the object. Will do that and see how it goes :)