After trying various things, I'm just going to give up and individually move all the p2 bodies in my scene/prefab.
As soon as the scene components awake, their global position is tied to that of their p2 body, so I don' think there is a way around it