Wow, I am surprised at how fun your game was to play! I am usually not the biggest fan of this genre and I am sure you already know of some rough edges in your game (like no sound or visual indicator when you get hit) but the modals attaching to your ship in whatever orientation they were when you touched them is so FUN and a really creative idea!
I can imagine getting a super goofy looking ship at the end of a run (a post game image of your ship is also something I would be interested in seeing).
Other than some of the obvious things to work on, a small tip I would give specifically to game jams is to tone down the difficulty. Unless a "core" mechanic of the game is to be difficult, people trying out a game jam game will probably not put in the time to "get good" and see everything the game has to offer.
Overall I had a great time trying out your game and I am impressed with what your team made in 96 hours.