I think this is the issue here. There's like 2 full screen buttons layered over each other. One of the gives the game the minimal screen box the other one actually goes full screen.
I removed the automatic one put by itch.io. It definitely seems to now be way within the screen border on full screen