Yes, it definitely alright!
Some people will definitely join near the start of the actual jam, and you're probably not the last one to join.