Thanks for the feedback! We did the game in 2 days, and I wasn't able to fix that (I think there's no workaround with it, and I should use Raycasts to detect collisions proprely).
I like this one, so I'll most probably get back to it at some point and fix that nasty bug :)