Guess I should have read the description! I beat the first levels without swapping and just by pushing the other objects.
haha, I've heard it from some other people aswell, but hey, if it works, it works ;)