I think it's fun, but also a little bit too annoying to keep playing for more than a couple of minutes. Maybe you can add a keyboard shortcut for switching control between the closest object (Sort of like alt-tab?), or maybe instead of CTRL/SHIFT + CLICK you could just make a right-click work? I really like it otherwise!