I wasn't being pulled in by the magnet. It may be an issue with the collider.
Was you using the robots that controls the ambient?
Edit: You were right. Looks like the magnet can't be dragged when it's on a wall. I will try to fix it.
I fixed it on the fixxed version. Try to click on the inferior right edge of the magnet.