I love the concept! I would suggest making a physics material with a friction of 0 to make the square not stick to walls. I had the same problem, and fixed it last minute. Great game!
Already fixed this in the newer Version, I will update after the jam. Thanks you for enjoying it <