I kind of rushed the game didn't have time to polish the controls. I changed some elements according to the gamers' feedback and will upload a newer version but I want to know if it is allowed during the voting period?

Yes, that's allowed. See below from the Jam Homepage FAQs

Can I make changes during the rating period?
Yes, just make sure that the original version of the jam can still be downloaded.