Would not all this depend on the type of copyright to begin with?
If they agreed to work together for a jam project, this sounds like a joint copyright and that has a lot of consequences. I do not know how or if you can retract your past contributions from a joint copyright.
Also, you can't add contributors to a project. Only admins. So I am assuming OP got booted from the admin list of the project.