It was because I was using Itch's new randomizer feature, which disables the fullscreen
Well I learned something new!!