Sorry to hear that, we never had issues playing together with different people. There is a limit of 20 people playing at once, because the multiplayer plugin we are using, maybe you could try it out later again?